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ABSTRACT 

In an attempt to determine a relatively standardized 
formula for evaluating children's television programs, a concept of 
flexible and varied means of exploring the characteristics of 
children* s responses to particular programs and styles of programs 
according to the kinds of questions that each program raises was 
developed. The ways in which the concept of evaluation was defined 
are outlined, and the research methods which were evolved for 
undertaking specific pieces of evaluation are described. An account 
of three pilot studies which were carried on existing programs is 
given, along with an estimate of the feasibility and utility of such 
an evaluation as a means of providing feedback on broadcast output. 
(JY) 
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It Rco:".:' incrc;x:s:ir.'?ly the c.-iso thr.t or/;;-/.!ii''''Jitdon.'j '■ 

c:oi!on.rnecl v.'r'th the production oi’ educational to.lovicion m j' u ir.v'oe 
tend to fool tho;.”.2clvc'i under non'.c.' obJ.ipation uo evnluat''* ■■ : 

and corrfiieporjfjlnply to jay at leant t.omo donjrec of lip n'. .rvici- to a 
not alwayo v/clil.-dcfinod activity called 'roueavoh' . 

Thin situation may be due in pai’t to the cmpiiaois p.rc.';e;itly bo;;>\; 

put on a 'cyatemn' approach to the buciness of tcaohiiip; cund learciny, 

as well as to the influence of the methodology of programmed i’-'otnic:- 

tion. It is undoubtedly also a result of the relative nove].ty and 

expense of iiitroducing television into educationa!!. organize ti>- .ns on 

a large scale, where its effectiveness and the consequences of its 

use are open to questioning and doubt. In these circumataneos, 

evaluation is likely to be considered not merely a praisev.'crtby 

* 

activity but even obligatory in principle. 

The introduction of evaluative and testing procedui-es may be 
further encouraged by the seeming fact truat the mediation of an 
electronic device such as TV 'distra:ces’ the makers and pi-csunters 
of a teaching programme from their audience, thus perriittiu.g ajt 
examination of its effects without undue embarrassment (altiiough 
producers and presenters are probably no less sensitive than class- 
room teachers to having their noses tweaked). 
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* Thus J.'imes V/ykes cam v/rito that 'no tfeacher can afford nr-t to k.'iov; 
as much as possible about the eff ect of nvoi’y educational programme 
he is concerned with*, and suggests tln.-.t where the dspio.y?-.'.ont of 
public funds is involved, as in many closed-cixcuit systo-, evalua- 
tion 'of both quantitative and qualitative data becomes a positive 
duty'. Cf. 'Problcns of Svaluation dji Educational Television’, 
Bulle tin of the Inst it;\ te of Education , Uiiiversi.ty of Londcui, 

Series, Mo, d?., Autumn term, 
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The kind of eTslmtlon of ochoole* broadcasts which is described 
below in this report, howerer, is not so much an actirity which 
relates to the crlticisa of telerlsion as a perforraance as one that 
inrolves the producers of programmes, in collaboration with researchers, 
in an exploration of how children react to their presentations, and how 
alternative forms of presentation may influence those responses. As 
such, evaluative activity may be regarded as a creative pro-e<^«, .lust 
as is the making of programmes, and one which may even come to be seen 
as integral to the conception and development of succeeding programmes 
and broadcast series. 

Originally it '.^d been intended that this one-year investigation 
for the Independent Television Authority should be devoted to the 
task of evolviiig a relatively standardised formula for evaluating a 
selection of the schools* broadcast output of the Independent programme 
companies. It was hoped that this might lead to the development of 
several set methods of sampling and testing pupils' responses to broad- 
carats, and would issue in the construction of standard forms of 
questionnaires which could be systematically administered by company 
Education Officers. Such an approach, however, has appeared Increaising- 
ly contrary ':o the philosophy of research which has emerged during the 
course of the year’s investigation, one consistent tb^wne of which lias 
been to adapt flexible and varied means of exploring the characteristics 
of childrens’ responses to particular prograoies and styles of programme- 
making according to the kinds of questions and problems that each pro- 
gramme or broadcast series raises. 

The following chapters of this Section outline how the concept of 
evaluation was defined and the research methods which were evolved for 
undertaking speeifie pieces of evaluation. Section II provides an 
account of three pilot studies which wears eaxrled out on cuirent 
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material broadcaat by several of the major Independent programme 
companies. Finallyi on estimation is attempted in Section HI 
of how feasible in practicciond how usefuli such activity might 
prove for the companies concornedi if It was to be more widely 
adopted by them as a means of providing feedback on their 
broadcast output. 
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A FIRST LOOK AT EVALUATION 
What la Evalitfctloa? 

One way of approaching the evaluation of an educational telo*" 
Tiaion broadcast is to treat it as a *produ?t', likening the process 
of aseossoent to a Which oxaraination of a car or washing aachins. 

In this eoproach* the various qualities or ctaracteristlcs of the 
product can be tested against previously es^Ablished standards of 
efficiency in perfornance. Such measurement is frequently compara- 
tive, the performance of the product being compared with that of 
another in terms of different aspects of its functioning, after 
which a ’best buy' is indicated. 

One crucial difference between hardware, such as cars and 
washing machines (and TV receivers), and the software of a television 
presentation, lies in the degree to which the evaluator is dependent 
in the latter case on the reactions of the consumer (i,e, the members 
of an audience) in oalcing his judgements. In the case of a car or a 
television set, it is possible for the tester to Judge, accurately and 
objectively enou;](h, the dependability of the product in action, and 
the main characteristics of its performance, without requiring the 
similar estimates of a representative sample of users. This will hold 
good except for certain features, such as those of styling and appear- 
ance, where an 'objective' estimate will require the gathering of 
opinions from a wider sample of consumers. But in the ease of a 

* 

television broadcast, any evaluation must depend almost entirely on 

► 

knowledge of the reactions to it which are representative of its 
users; aud the Judgement cf any individual critic will necessarily 
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remain speculative unless he is in a position to maike generalisa- 
tions based on a thoroughly tested knowledge of audience reactions. 

tfhat is the Standard against which the Effects of a Programme 
can be Measured? 

In discussing the way in which consumer products are commonly 
evaluated, it. was said tnat particular features of the product are 
tested against a previously established standard of I'fficiency in 
performance, and that such measurement is frequently comparative. 

But if one can generally only talk of evaluating a broadcast in 
terms of the way an audience reacts to its qualities and character- 
istics, then it is the performance of an audience on some form of 
test which must determine any judgement of the programme's effective- 
ness.* How, then, does one establish the required standard or level 
of performance of am audience, which will indicate that a programme 
is functioning efficiently, or that one style or feature of presenta- 
tion is more effective than another? There are several ways commonly 
adopted by researchers. 

1. Compaurison with a norm 

For this approach, it is necessary to establish, or to have 
available, a norm, which indicates the average level of learning or 
achievement m, for example, aspects of a particular school subject 
fop a given age group. 

« 

It is worth noting at this stage that the notion of measuring effect- 
iveness by means of audience achievement on a test with set standards, 
which is commonly associated with the evaluation of educational pro- 
graoDes, is one which may suggest a rather too limited way of investi- 
gating what is learnt from a programme, i.e. the knowledge which is 
acquired from it, and the way it is understood by an audience. An 
alternative approach is outlined in the following chapter. 

10 
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A good illustration ie provided by a piece of rooearch being 
undertaken by the lUEA TeleTision Service into the three-year TV 
French ea.rieB which it le transmitting, the aim of which, according 
to James Wykes, its Director, is to'nssoss the level of attainment 
achieved by children who have followed the television course for 
two years, compared with a control group of matched age and ability 
who have learnt French by other methodn'. In this case, a aonn of 
achievement by cnildren has already been established by the 
National Foundation for Educational Research in a stuc^J• of French 
teaching in primary schools. Consequently, it is possible for 
the II£A Television Service to administer the same testa of listen- 
ing comprehension and oral performance at an equivalent stage of the 
TV pupils’ French coxirse. 

There su'e a number of reasons, however, why comparison with a 
norm is not likely to be a useful approach so fhr as schools' TV 
broadcasting is concerned. 

First, it is most unlikely that noms will be found to be readily 
available for comparing the learning of children from TV in a specific 
subject matter area with that of others v/hcee leatrniag is mediated solely 
by a classroom teacher or tlxrough other resources. In any case, con- 
siderable doubt has been cast on the validity of such comparisons, unless 
very strict controls are applied to ensure that the compirieon is an 
exact or fair one. The anus of schools' broadcasts, and the ground 
covered by them, ore likely to differ considerably from set syllabi in 
schools and, whore they correspond to a syllabus, to be supplementary, 
rather than aiming to provide c comprehensive course in themselves (as 
with the lIJSA French aeries). 
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Seeondf ej.nc« teacher follov-up is often considered integral to 
schools' broadcasting, the participation of indlrldual classrooa 
teachers will ineTitably influence the direction and extent of 
shildrans* overall learning froo a given series* !HiuS| if one wanted 
to compare the learning from a schools' TV series with a norSf it 
would be necessary to test children in a large nucber of schools to 
assess the average extent of learning from it* This would not only 
present prohibitive difficulties in terms of tim and expense but would 
tend to mask revealing differences between one classroom and another* 
uiiless an exhaustive analysis of the findings was made* 

Finally* such broad compar Isons* vdill^ providing an idea of the 
overall effectiveness of a programme aeries* cannot readily indicate 
why particular broadcasts have been successful (or the reverse' in 
creating interest or promoting learning* or what features tended to 
render then more or lees effective* That is, they do not really tell 
the researcher .jueh about the specific qualities or characteristics 
which a programme possesses* 

2* The attainment of objectives 

Ancther approach* associated particularly with programmed 
lnsti*uction* is that of stating the learrting objectives of a presenta- 
tion in a precise manner* e*g* the facta* principles or skills which 
the programme is intended to convey* and the mastery of which the 
learner should d monstrate* In this case an arbitrarily chosen level* 
Indicating an acceptable degree of success in achieving objectives* is 
used as s standard against which the performance of an individual or 
group can be asseesed* 
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Schools’ TV broadcasts, however. frevAi’ently hove ains or obji.ciiv-; 
the attainment of v;bich if. not measurable in a striifjhtfoivard '.'av tv 
■iieans of conventional tests. They may, for instance, bo intondoj, to 
stimulate longer-term interest and thought about the concepts of a 
subject like mathematics, or imaginative activities such as painting or 
the writing of poetry. Such qualitative outcomes are difficult v.o 
assess, and the difficulty is considerably increased by the complex 
influence of the teacher in classroom ’follow-up' and uusupervised 
peer group discussion. Furthermore, broadcasters often i-egaz'd pro- 
grammes as providing materials for teachers to utilise in diverse v.-Ay--. 
according to their own needs and the needs of their classes, and in sso; 
cases their objectives can only be stated in a rather general manner. 
Finally, to state objectives and test their attainment may frequently' 
lead to the overlooking of what a schools’ programme has meant to the 
children themselves. That is, the child will produce a personalized 
response to the material which will be dependent upon' his previous 
experience' £ind the set of needs, attitudes and expectancies which ho 
brings to the'vie’wing situation. Consequently, he may be affected 
by the programme and put it to use in ways quite other than those that 
were preconceived by the educationalist or broadcaster. 

If this last argument is accepted as a decisive one, then another 
approach to the question of evaluation is clearly necessary. The 
following chapter describes the developnent of such an alternative 
approach, one which does not depend on the establishment of prior noir:.s 
or standards of achievement, and which appears to be potentially suitatl 
for application to schools’ broadcastsuig. 
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Cliapber 5 

AN ALTJJKi^ATIVS APPRC)ACH TO miUATICN 

In seeking an approach tailored to the needs of schools' broad- 
casters, it seemed best to look again at the concept of evaluation 
in the simplest manner. What does it mean to evaluate a broadcast? 
Sure.ly it is tantamount to asking: ’’What is the value of my 

programme? ‘ • 

Such a value cannot exist in any absolute sense, hov/ovei-, unless 
one is thinking in terms of cost-effectiveness. (Even then it is an 
elusive notion.) Rather, one is questioning the value or usefuDness 
of programmes for someone, and so one is led to ask further, 'Valuable 
or useful for whom?'. 

There are, in effect, two users of schools' broadcasts teachers 
and children. For teachers, they may- be sources for the presentation 
of informcition, ideas and new methods as well as a stimulus for furtre 
activities, in their classrooms. They are a teaching tool and as such 
will quite simply have value according to how useful any indiv-idual 
teacher finds them for his or her classroom teaching. 

The other users are the children themselves. As has been pre- 
viously insisted, schools' broadcasts are not planned to exist in 
isolation, but are conceived as part of a teaching and learning imit 
which includes preparatory, and especially follow-up, activities led 
by a teacher. It is nevertheless : justifiable to consider broaacasts 
as having in themselves a 'usefulness' for children, v/hich will inciuc, 
their experience of a programme and 'the personal meaning it has for 
them as well as any factual knowledge they may acquire. Ti-ie three 

A 

pilot studies descaribed below provide evidence to support the validity 
of this viev; and the utility of methods that are consistent v;ith it. 
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To estinate the value of any progranune or series^ therefore • one 
should ideally combine a measure of their usefulness both for teachers 
and for children. The gathering of teachers * eonmients by means of a 
card reporting system is already undertaken by the companies. While 
open to CTJticism and inprovementt the system in practise may provide^ 
when combined with visits to schools by company Education Officers, 
an adequate gauge of teachers' reactions to broadcasts* 

The card reports are also intended to elicit teachers' observa- 
tions of childrens * reactions. Such comment may be informative and of 
considerable interest to producers and Education Officers. But the 
tendency towards unanimity of reported opinion, from what seems the 
great majority of classrooms, suggests that pupils' responses may be 
influenced or intex*preted by teachers in ways that preclude these 
reports from being considered as in any sense objective assessments. 

The possibility of gathering childrens' responses by means of more 
rigorous research procedures, however, offers a potential source of 
reliable feedback, which is vxrtxudly untapped by schools* broadcasters. 
While presenting a task of some complexity if attempted in any depth, 
may nonetheless prove remarkably rewarding and revealing for then 
in outcome. 

By questioning children directly, it is possible for the producer 
to ask, 'Have I communicated what I wanted to comamnicate? ' . That is, 
'Have pupils miderstood or Interpreted the content of the programme in 
the way 1 intended? Were my essential points the main ones for then, 
or were they more concerned with what were for me peripheral ''speets?'. 
By the same token it enables him to ask, 'Vhat have the children 
selected as inportsmt or interesting for them about a programme?'. Kow 
do they relate sequences in it to their own lives and experience? What 
parts have influenced their opinions or engaged their feelings? 

15 
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The answers to such (questions should concern the producer in two 
most joportant ways. First, they can indicate the more general effects 
of his comounlcation, l*et the way in which children have absorbed the 
progranse content into their own personal experience and understanding 
of a topic and how their perception of it has been nsodified by viewing 
the programme* Second, they can provide him with lAformation about 
what sorts of veiriables are crucial in influencing how children tend 
to respond to a programme, and so help to reveal to him the qualities 
and effects of different styles and features of presentation, or of 
changes in the viewing environment* 

An approach of this nat\u:e, which can be labelled pupil->centred 
or child-centred, and which is characterized by its admission of a 
freedom of response rather than limiting itself to responses dl<^tated 
by defined objectives, thus has functions which are beyond the scope of 
more traditional educational testing* Bssentlally the question of 
evaluation is restated as a question of experience and understanding* 

How does the child experience the programme?* What does he come to 
understand about the relationship between himself and the programme? 

And it is this restatement in terns of experience and tmderstanding which 
endows the child-centred approach with its multi-functional character* 

Thus« it can act as a means of diagnosis for the producer, indica- 
ting which sequences hold childrens' interest and attention, or arouse 
strong feelings and opinions, and whether pupils are clear or confused 
In their grasp of particular parts of a programme* By revealing the 
way in which children react to and interpret progranme content, it can 
also indicate how successful the producer has been in communicating in 
the way he intended* 
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Furthermore I it can guide the producers' .judgement « for example, 
about the most satisfactory choices to make between alternative forms 
of presentation, or the effect of a particular type of presentation 
on different groups of pupils. 



Finally, it cein be a source of insight for teachers, by helping 
to reveal how groups of children perceive programme sequences at the 
time of viev/ing, and that state of mind in which a broadcast tends to 
leave them in the immediate post-viewing period. The studies carried 
out during the course of this year have all attempted to chairt whore 
children *are', v;hat their understeinding of a programme is, at the 
point when the transmission ends and the teacher must pick up the 
threads for discussion and activity in the -classroom. 



The following chapter discusses the relationship between such 
evaluative experiments eind research that is commonly regarded as 
more 'basic' in character. 
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Chapter 4 

THE CHOICE OF RESEARCH METHODS: 

EVALUATIVE VS. BASIC RESEARCH 

In the two preTioue chapters various aiterrAtlve approaches 
to what may be called evaluative research have been broadly outlined* 

On the one handy pupils* performances on a test of learning may be 
compared with a norm, or against a previously determined level of 
attainment.; which indicates their success in achieving the learning 
goals or objectives of a programme* On the other handy the researcher 
may attempt to determine the value of a presentation for its audience • 
by probing by different means the ways in which members of that audi- 
ence respond and react to it. 

Tb.e term, 'evaluative research*! has been deliberately chosen. 

For a distinction has sometimes been made between the activity of 
evaluation and that which may be known as basic or fundamental research * 
Confusion i.s likely to result unless it is made clear whether the 
frequently cited distinction between these activities is supposed to 
refer to their aims or to their methods* 

The aim of evaluation may be seen as proviairig feedback, from 
which practical judgements and decisions about future production and 
transmission can be made* Evaluative research is generally regarded 
as programma-speeifiCy chat isy as providing feedback relevant only 
to the particular broadcast or series of broadcasts under scrutinyy 
and precluding wider generalization to other output* 

Basic researchy on the other handy seeks, it is ofte:j implied, 
generalisable results or conclusions, which may not have any immediate 
application to programme presentation* It will be argued below, how- 
ever, that such a distinction becomes an artificial one if the approach 
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to evaluation defined in Chapter 3 is adopted* 3y looking at one 
of the claasic methods used by psychologists in uadert6dcing research) 
that of conducting a basic expertnehtal investigation, it should be 
possible to clarify this point of view* 

The steps taken in preparing ad experiment axe likely to include 
the following: 

First, the deliberate variation of some aspect of presentation 
(e*g* style of commentary, use of still or moving pictures) or of 
audience characteristics (e.g* comparison of the responses of two 
age groups, or of children from schools with a different socio- 
economic intake), or of environmental factors. 

Second, the doveiopment of a hypothesis, which is a precise state- 
ment of the expected behaviour or performance of a given audience after 
being exposed to a particular presentation under certain conditions 
rather than others. 

Third, a statistical measure of the differences which emerge from 
these comparisons, indicating the extent to which any differences are 
significant, that is, likely to recur if the same experiment was 
repeated, and not due simply to chemce fluctuation* 

Thus, we might hypothesize tnat a slow and repetitious style of 
commentaury will 3.ead to better comprehension and retention of the 
content of a programme tliaa a faster-paced one, or, alternatively, 
that it will lead to boredom and therefore poorer attention and learn- 
ing a/ioria children. We would then need to compare two programmes with 
differing commentary styles and to determine whether any significant 
differences were exhibited ia the responses of two comparable viewing 



audiences 



Whereas evaluative research is considered to be prcgranne> 
specific, basic research is supposed to seek generalisable results* 
So, in the above case, the researcher would not be interested so 
much in evaluatxr^ the two contrasted programes in themselves, but 
rather, in using them as a means of determining in general whether 
such and such a commentary style is likely to be an effective pre- 
sentation feature for all audiences with similar characteristics* 

But if generalisable results are the aim, the researcher must 
be confident that hie coverage of the appropriate audience has been 
truly comprehensive* In. the case of schools' broadcasts, he will 
need to query whether children of different ages, abilities and 
interests, with differing personal styles of learning and perceiving, 
and from varying family and social backgrounds, will in fact respond 
in like ways to the same features of presentation* And he will want 
to know vdiether responses to a particular aspect of production will 
hold good for different kinds of subject matter and whether it will 
elicit one kind of response (e*g* clear comprehension) but not 
another (e*g* stimulus for further activity)* It is only by testing 
a hypothesis under a host of systematically controlled conditions 
that one can eventually speak of having truly generalisable findings* 

If the aim of basic research, then, is to seek generalisable 
findings about audience responses to programme presentatiorS • it %rill 
only be by studgdng reactions to a range of partieular broadcasts 
that widely applicable findings will be able to emerge* 

But similarly, in the ease of evaluative research, while the 
initial aim may be to seek feedback specific to a partieular programme 
or series, the accumulated findings of studies probing responses to 
individual broadcasts may begin to build towards a consistent pattern 
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of results , indicating their possible goneralisability. That is, it 
should enable a producer to gain a more general appreciation of 
whicn variables are consistently proving influential in determining 
hov children respond to hxs presexications* (Sven so, the final 
outcome may well be a clearer awareness of the complexities implicit 
in differing sirciuBStances rather thaui a simple result that fits all 
Edtuationsj) 

It is here that the distinction between methods which compare 
pupils* achievements with a fixed norm or standard, and those which 
are intended to be more exploratory of children's responses, becomes 
crucial. Traditionally, evaluative research has been regarded as an 
activity essentially wedded to linited and specified techniques of 
data collection and analysis. But if children's responses are to be 
sensitively ejqplored, then the researcher will need to call upon any 
of the methods of precise observation and experimentation employed by 
social scientists, as appropriate. It is only the latter approach 
which will enable partictilar qualities and characteristics of broad- 
casts to be revealed according to the nature of those responses. 
Svaluative research, then, ought not to be confia*#"p to .any single 
method of data collection and analysis. Like basic research, it 
must be free to use whatever teohniques of investigation which seem 
to promise to clarify the specific probl«BS that have been posed for 
examination. 

All of this suggests that, far from being opposed, evaluative 
and basic research ought to feed into one another to similar ends. 

For both most begin with an examination of specific prograaDes, and 
both will build towards an understanding of factors in television 
presentation and reaction which are of consistent and general import- 

zi 
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As to the choice o£ research methods, one or another will tend 
to be more svtltable according to how well-developed the researcher’s 
understanding of a problem is. Where he has a strong hunch, or has 
accumulated sufficient evidence to hypothesize that such and such a 
variable in presentation is likely to influence children's responses 
in a particular way, then the experimental method may well be appro- 
priate. Where ho wishes to make a more exploratory probing of 
responses to a presentation, other more open-ended approaches may 
be more revealing. Indeed, any single investigation may deploy a 
combination of methods, as in the case of the Thames Television 
Patterns of Expression study (Chapter 6), where both experimental 
comparison and more ({ualitative analyses were adopted. With a 
skilful integration of techniques, the researcher can. combine the 
strengths of different approaches and avoid some of their inherent 
limitations. 



\ 



I 

[ 

{ 

t 

j 

i 

j 

i 

[ 

S 

V 

( 

J 



I 



MC 



r>*?. 



SECTION II 



TUE APPROACH IN PRACTICE 



Chapter 5 



THE PREFAJRATION OF A iiESEARCH STUDY 

An aeaumptlon underlying the approach to research described 
In this report) insofar as it is intended to apply specificaUy 
to the eTaiuation of schools* broadcasts, ue that it should 
inTolve the producers of programmes and the researcher in a close 
collaboration. It is* after all, schools' broadcasters themselves 
(and, through them, the teachers and pupils) whom the research is 
intended to oenefit, ao.d it is they who can best initially indicate 
the practical problems and questions which are pressing with 
respect to particular productions. 

An important aspect of the year's work, therefore, has been to 
examine the most saticfaetory means of combining the experience and 
insights of producers and researchers, and how the actiritles associ- 
ated with reseaurch can be collaboratlvely undertaken by them. The 
main steps which were found to be necessary in shapir^g and executing 
a piece of research, and the way in which research activities were 
distributed in the three studies undertaken witn the Independent 
programme companies, can be cutllned as follows: 

1. Selection of a topic for reeear-ch 

All three projects began with an infonscil meeting between the 
researcher and the members of the Schools' Broadcasting Department 
of the company concerned. Discussionu characteristically ranged 
over problems and questions in the minds of producers of particular 
series, and those which seemed of more general interest, and amenable 
to tackling by research methods, were selected for further eonsidera- 
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2. Tho shaping of a research Btutfar 

next step invol-esd the researcher in giving shape to one 
or more possible studies. This meant that he hal the task of deter- 
mining precisely what it was that the research was intended to dis- 
corerf developing testable hypctheeeSf deciding which aspects of 
presentation might be examinedt tlie composition of different groups 
of children whose responses were to be gathered and coopuredf and 
what sorts of measures it would be desirable to employ. 

3. Final deeision-maKing 

Aft'rr planning the desi^. of possible studies} the researcher's 
proposals were then re-submitted to those members of the Department 
wishing to be further involved in the execution of the research. A 
choice was made between alternative aima and designa, possible modi- 
fications were suggested} and a final shape was then agreed for the 
study. 

Preparation of questionnaires and measures 

It was then up to the researcher to prepare a questionnaire 
by means of which childrens' responses could be gathered and analysed. 
This involved decisions about both question format and item substance. 
Whenever possible} this task was undertaken in consultation with a 
producer or Education Officer directly concerned with the programme 
to be examined} but final responsibility was assumed by the researcher. 

5. Practical planning 

The planning of the actual running of the researcher was now 
taken over by a company Education Officer in close eonaultatlon with 
the reeearcber. The number of children to be involved in the study} 
and the schools from which they were to be drawn} was decided. They 
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had then to oe randomised into different groups, the method used 
being that of giving the children numbers and then snuffling and 
dividing a pack of numbered cards. Precise plans were made with 
the schools involved for the study to be run at a given time, or 
for children to be brought into the company’s television studios. 

At this stage any dubbing or ro-editing of the progracmie was 
also undertaken, and in one case the questionnaire was pre-piloted 
in a local school and modified in the light of children's respcnses. 

6. Classroom running 

The actual running of a study, that is, the administration of 
questionnaires in a school classroom or company viewing room, was 
prifflariir the responsibility of coapamy Education Officers. This 
included the task of ensuring that equipment le.g. videotape 
recorder and monitor) was set up in advance, that children were 
sorted into groups and sent to the correct room, and that the post- 
viewing procedure was properly explained to them nnd supeivisei. A* 
this stage is the most liable to mishap and requires careful admini- 
stration, it proved beneficial for the researcher to be init ially 
involved, where hie experience could help to Iron out pltfuJls. 

?• Collating and analysing the 'lata 

The next stage of collating aind ar:^ly6lng the responses gathered 
from pupils had necessarily to fall for the most part on the 
shoulders of the researcher, as it required his particular skills. 

Use was made of University computer facilities, and some of the work 
was delegated to post-gtaduate students. Where appropriate, results 
were tested for their statistical significance. 

2G 
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8* latorprctufl; tne eTidence 

Having analysed the datag the last important task was to 
consider the implications of the findings* Being closest to 
the evidence! the researcher was best qualified to formulate 
a provisional interpretation, but further discussion of this 
between himself and tne company members involired was an eseen-' 
tial part of the process of finding the most satisfactory 
explanation of the study’s results* 

Some cf the practical needs which required attention are 
furthei' discussed ic Chapter 9* The following chapters of this 
section provade a detailed account of how tiiree research studies 
were planned and executed in collaboration with Thames Television, 
Yorkshire Television, and Granada Television, respectively, and 
of the findings which emerged from them* 



Chapter 6 



STUDY Is 

THAMES TELEVISICK'S PATTERNS OF EXPRESSION 

i 

The project’s first substantial investigation was undertaken 
in collaboration witn Thanes Television* It was a study of the 
responses of children to a progranme in a new series, Patterns of 
Expression * which was intended for pupils aged 9-12* The series 
dealt with selected aspects of anieal and human behaviour, in 
particular comparing some of the ways in which animals and human 
beings communicate and express themselves. Since its principal 
aims were to stimulate observation and encourage creative thinking, 
discussion and writing, a constant feature of the programmes was the 
showing of familiar patterns of behaviour in new contexts* The 
specific focus of the research was the first broadcast in the series, 
which was devoted to the tneme of Display . This examined the 
functions of display benaviour in animals and emphasized those human 
patterns of expression, e8peciaLl3,y in dress and fashion, which tend 
to serve similar ends* 

The Preparation of the Study 
Deciding the aims of the study 

An initial step was a meeting between the researcher and 
producers and Education Officers of Thames Television, which was 
arranged by the Head of the company's Schools' Brcadcasti^ Depart- 
ment* To this gathering the reseetrcher first outlined some of his 
ideas about the evaluation of schools' broadcasts, the kinds of 
research techniques that were available, and the benefits which the 
company could 'i«rive from their use* Then some possible applications 
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to Iho Department's output v;ere discussed j after which it was 
decided that children's responses to the opening broadcast in 
the Patterns of Expression series could provide a fruitful field 
for investigation. This decision reflected an interest in the 
reactions of pupils to the important part played by visual 
materials in promoting the teaching objectives of the programme, 
in which novel combinations of pictures were used tr present 
certain concepts that might have initially seemed unfamiliai' 
to the viewers. 



At a further meeting some more specific areas of concern to 
company members v/ere canvassed as possible themes for a study. 

They included: 

1. V/hich parts of the programme did the pupils like best? 

2. How well did they imderstand the programme content? 

3. Were there any differences O'f response between children 
from schools drav/ing their pupils from contrasting social backgrounds; 

4. Would it enhance or detract from children's appreciation of 
the programme if a link-man were used on vision, instead of the voice- 
over technique which the series had actually employed? 

5. To what kinds of follow-up teaching did various sequences of 
the programme lend themselves? 



It was decided to pursue the first four of these concerns .within | 

I 

the framework of a single research design, concentrating especially on | 

•V 

5 

pupil comprehension of programme content. The issue of teacher follow-^ 

j 

up was dropped at this stage because it would have posed a quite 

( 

different kind of research problem. The main aims of the study were 

! 

defined, then, in terms of an examination of children's underst-anding | 
of the programme content and of differences of comprehension occurring ; 
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among pupxis from ecnools with contnvetLng socio-oconoaic intakes* 
Subsidiary aims were to investigate the parts of the programme chat 
proved most interesting to the pupils and whether they would have 
preferred to be able to see the linic-itian whose voice had delivered 
the commentary* 

Operationalising the aims of the stucLv 

The measurement of children's interest in various parts of the 
broadcast was a matter of fairly straightforward questioningi but 
assessing the.lr understanding of the programme content posed a more 
complex problem* There seemed to be two main ways In which this 
could be approached* One could exsuclne how tar the pupils had 
'gz^ped' the veurious aspects of the concept of display as they had 
been presented in the programme* That is, did they understand 
sequences of the programme in the way that the producer had ictenaed? 
Did their way of 'seeing* things and relating them to each other 
conform to his? Altemativelyf one could try to look at understandiisg 
from the child's own point of view and ask: How did he personally 

interpret the programme's ideas? How did he weave together the 
materials presented in it? What sorts of personal meanings did he 
assign to those materials? 

On reflection it was considered that euiy thorough investigation 
of children's understanding of programme content should include both 
aspects* We were then faced with the task of devising ways of 
questioxiing childrer* so as to elicit responses which would reveal the 

C 

nature of their understanding* The programme producer had organised 
and presented his ideas and materials in a particular way* To what 
extent did pupils' responses after viewing the programme reflect a 
siailar manner of organisation? To what extent did they diverge? 

What were the dominant ways in which pupils tended to interpret and 



20 






27 



! 



i 

f 

I 

I 



l: 

(• 



ERIC 



or(?aiiise the concepre which the programme had presented? 

It was immediately evident that any attempt to answer 
these questions would have to be based on a prior and careful 
examination of the ocnteni of the television presen tat.ioj.„ An 
analysis suggested that the programme centred on ”52 film 
sequences, each of which nu^ttaposed examples of animal and 
haman display. These sequences in turn j-llustrated six 
different purposes of display; to express authority, status 
or aggression, to attract, to show conlormity and to camouflage 
(a form of anti-display). 

The function of the commentary appeared to be one of 
establishing these six categories by explicitly indicating the 
relationships between one or another of the filmed examples of 
display presented in the programme. Thus, its role was to link 
and impose a structure on what might otherwise have been seen 
as a series cf independent film clips (which could have been inter- 
related arbitrarily by the children according to their own individ- 
ual preconceptions and associations). Prom the producer’s angle, 
understanding of the programme could be said to turn on the 
viewer’s ability to associate particular visual examples of human 
or animal display in terms of the six categories of the purposes 
of display which the programme commentary had explained. 

A possible method of investigating children's understanding 
of the programme content was now apparent. By comparing bow a) 
children who had viewed the programDe, and b) similar pupils not 
exposed to it, organised and interpreted various visual examples 
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of display, it would be possible to ascertain how far the 
programme had succeeded in impressing its categories on the 
pupils and to what extent they still tended to rely on their 
own preconceptions in responding to the programme's materials. 

Determining the research techniques and materials to be used 

The most suitable method of representing the prograriime ' s 
six categories of display appeared to be that of reproducing 
six pairs of photographs, each. pair deriving from the film 
sequences that had been used to exemplify a particular category. 
This yielded the follov/ing set of categories and photograph- 
pairs: 



Categor.y 


Photographs 


Authority 


Policeman/Judge 


Status 


Ascot dress/Queen at Coronation 


Aggression 


Attacking sv/an/Hell's Angel 


Attraction 


Lyre bird dancing/Carnaby Street i 


Conformity 


Hippies dressed alike/Penguins 


Camouflage 


Giraffe/Soldier in jungle uniform 



I 

I 
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It then became possible to present a set of these 12 photograp: 
to children, asking them to group them in the way in which they 
thought the pictures v/ent most appropriately together. Such a 
simple sorting task permits a statistical treatment of the results. 
In general terms the hypothesis under investigation is that the 
pupils v;ho viewed the programme would afterwards shov/ a greater 
tendency to group photographs according to the producer's pairings 

than would those in the control group v;ho had not similarly seen 
the programme. Of course the viewers were unlikely to reproduce 
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the producer's pairings perfectly. Hov.'ever, the prograrp.nie 
could be said to have been effective if the photographs 
grouped by the viewers included significantly more producer- 
based pairs than did those provided by the control group 
children v;ho had not seen the programme. 

This procedure would show what photographs children 
associated with each other; in itself it would not establish 
why they had put them together and how far the concepts 
developed in the programme had 'actually governed their group- 
ings, In order to explore the child's manner of experiencing 
and interpreting the programme content at this level, a more 
open-ended form of questioning was called for, and it v/as 
decided to ask each pupil to outline in. note form his reasons 
for having grouped the photos as he had. 

Two approaches are suited to the analysis of such ' open- 
ended' data, and both v/ere envisaged. First, the children's 
reasons for combining photographs could be sorted into various 
categories according to certain criteria, and the resulting 
tables could be statistically analysed for differences betv/een 
viewers and non-viewers. Second, in order to exploit the full 
range cind complexity expected in such free writing a qualitative 
analysis of the material could be attempted. 

Thus, the essentially simple photograph-grouping task could 
be analysed in three ways: 

1. Statistical analysis aimed at assessing the influence of 
the programme upon the pupils' photograph combinations# 

2. Content analysis of pupils' references to thedr reasons 
for having combined photograpshs as they liad, aimed at assessing v-ne 
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influence of the programne upon the classifictition schcnes use’i 
by children in producing g^^ps of photos# 

5* A more wide-ranging analysis of the qualitative 
characteristics of pupils* free waiting about the photograph 
groupings, aimed at assessing the influence of the programme 
on their understanding of tbs relationships that could obtain 
between different modes of display. 

It still remaineci to determine how to study differences of 
pupil understanding in terms of the social background of the 
children enrolled in different schools. It was decided that 
the subjects of the e: 5 >eritnent should be dravm from four schoc,lS 5 
two representd.ng an in talcs of relativeJ.y privileged socio-economic 
background and two frcni a relatively under-priviioged background; o 
Owing to shortage of tine, and uncertainty about v/hal were likely 
to prove to be key variables in guiding pupilo’ responses, it 
was decided to select the schools on a fairly rough-and-reGdy 
basis, drawing c-n th& school-vltiting wrosrience of cne of the 
compary^s Education Officers, 'i'he c’.ecision called for a 
prograame-view?j:g (eincurimental.) group ar.-' a non-programms- 
vxeving (coarrol) group in Ct -h school, Ccnseqaently, each 
school was asked to seTect two closscs; coicprining a minlmam of 
40 and a caxiiriun of 70 children, v;ho wo’old. then be rendooly divid^;<J 
into control end ej^erimentaJ,. grroupo by the Education Officer, by 
shuffling and dividing a pack of rubbered cards. 

Finally, a short cueetiornaire was devised. For the expert' 
mental group members only this included two questions, asking ’Vlhah;'! 
part of the prograrane did you find most interesting? rnd * Would 1ft 
be better if you could ecsetimss see on the screen the man whose 
voice you can hear on the prc.eTa*?rae?*, For all the pr.pUs, space 
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was also provided in which they v/ere asked to write dovai the 
photograph groupings that struck them as most appropriate arid 
tiie reasons for their groupings. As each of the 12 pliotos 
was lettered from A to J, the pupils had only to work with 
sets of letters. 

Classroom procedure for the study 

The following classroom procedare for carrying out the 
study was agreed by the researcher and the Thames Television 
Education Officer, who v/as to supervise the actual execution 
of the experiment in the schools: 



.1. For experimental groups: A Sony VTR to be installed in 

the classroom before the commencement of school, or during 
break-time or the lunch interval. The VTR to be hooked up to 
a company or school monitor (if available). The Education 
Officer (E.O.) to begin by saying to the class, 'I'm from TliBjiios 
Television, and I've got a new programme here I v/ant to show you. 
The VTR to be then started and the prograimrae played through. 

After the programme, the E.O. to give out questionnajj'es 
and sets of photos in packets, msirked, 'Do not open until 
instx'ucted. ' He was then to read out the two questions on the 
questionnaire, and after completion by the pupils, to say: 



In your packet there aire twelve photos.' In a minute 
I v/ant you to lay these photos out on your desk, and 
to have a good look at them. Then I want you to put 
them into piles of photos which seem to you to go 
together. The smallest number of piles you can make 
is two , and the largest is six . It's up to you how 
many piles you choose to make. You have five minutes 
to do this sorting into piles. Use your own ideas - 
don't discuss your piles with the others. Right, open 
the i)ackets and go ahead with the sorting into piles. 



After tha piles have been sorted, the B.O. to say: *NoW| 

1 wddat you to take one of your piles and write down on your 
Sheet of paper the letters on tha photos in that pile«' 

Vnien the pupils have written down their letters, the E.O. 
v/as to say: ‘New, I (.rant you to write down on your sheet why 
you have put these piles together. So write down this sentence 
which is on tne board (Points to board) and then complete it.' 
E.O. then to read the beginning of sentence on the boaird; 

'I have put these photos together because • . 

Vfhen the pupils have vnritten down their explanations of 
their piles, the E.O. to say; ‘Now draw a line across the page. 

Do the same for each pile in turn until you have finished with 
your piles.- When the pupils have finished their piles, the E.O. 
to say: 'Please v;rite on your sheets your name, your age and 

whether you are a boy or girl,' The photos and sheets then to 
be collected. 

^ • For control groups 

The E.O. to slip av/uy from the experimental group as soon 
as he is satiLfied that the VTB is v/orKing correctly and to go 
to the control group. He is to say to pupils; 'I'm frwn Thames 
Television. I have some photos which we want to use in a 
programme. To help us do this in the best way, I want you to show 
me how you would put these photos together.- 

He la then, to hand out packets of photos and sheets of paper 
and to proceed as with the experimental groups. 



A class teacher is to be ia each of the classrooms 
supervise pupilfi, so that the E.O, can move between the two 
classrooms to give instructions in turn. Neither the teacher 
nor the E.O, is to give ariy help to the children, apax't from 
repeating the exact written instructions (as above). The only 
exception to be when a pupil finds himself stuCK, with photos 
he does not Know how to classify. He may then be told quietly 
to r,;*ike a separate pile of ' leftovers ' , 



The Execution of the Study 

Sxunmary of the aims and desi)tn of the study 

A brief summary can now be given of the aims and design 
of the study: 



Principal aims: 



Subsidiary aims: 



Subjects: 



1, To extunine childrens' understanding 
of the programme content, 

2, To compare the understauiding of 
children fz^ schools with a more/less 
privileged intake, 

">• To determine the parts of the programme 
wh ch most interested children, 

2, To determine childrens' preferences for 
a liak~nau or voice-over manner of pre- 
sentation, 

218 upper primary school pupils (10 - 11 years 

old), drawn from four schools in the Thames 

Televiaion (London) region, as fellows: 

More privileged schools, N s 126 
Less privileged schools, N • 92 

The pupils to be randomly divided into experi- 
mental (programme- viewing) and control (non 



Methods of 
data 

collection; 



Methods of 
Analyala; 



» 3 *+ m 

prograinmo-i'iewing) groups in eacti school* 

1. Childrens = understanding: 

a) Pupils required to sort twelve 
photographs, representing sequences 
in the programmes, into groups of 
photos 'which go together’, 

b) Pupils required writs a brief 
account of why photos have been 
grouped together, 

2* Childrens' interest and link-man preferences: 

a) Brief written account required of part 
of programme found most interesting, 

b) Preference for link man to be indicated 

by a tick placed beside one of the follow- 
ing pheases: ’Better', 'not so good*, or 

'much the same' (oe voioe-over), 

1, Pupils' understanding: 

a) Extent to which pupils reproduce producer 
pairings of photographs. A comparison 
between the experimental and control 
groups in all cchooJs combined and in two 
types of schools distinguished according 
to the social background of their intakes* 

b) Frequency of use of pf^ucer-bnsed cate- 
gories to explain photograph groupings to 
be compared for experimenwii and control 
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gTuupa in all schools combined and by 
social background of schools. 

c) Qualitative analysis of children's 
descriptions of categories. 

2. Children's interest and link-man preferences: 
Measurement of frequency of preferences, in 
experimental group only, for schools combined 
and between schools according to their social 
background. 

Results of the study 
1. Children's understanding 

a) Comparison between children's photograph groupings and 
producer's pairings 

A first analysis was specifically designed to assess the 
influence of the programme on the groups of combined photographs 
which the children formed after having seen it. Teiking the 
pro/praunme content as a guide to this part of the analysis, there 
were six 'correct' pairings that the children could have reproduced, 
and the munber of times that each of the 'correct' pairs was 
included among their combinations is shown in Table I. This 
ignores differences between the schools taking part in the study 
in order to concentrate attention on the programme's influence as 



TABLE I 



Tha Froquency v/ith V/'nich PuT)ils Grouped Phoi:.oa in Co 'v -'or.'iir. :.' 
with bhn Producer's Pairin;"S 



Producer's 


j 

Pupils selecting producer's pnlringn j 


Pairings 


Control 


ExperiBient;;.! 




Groups 


Groups 




(N = 109) 


(N = 109) 


Policeman/ Judge 


% 

54 


% 

80 


Ascot dress/Queen 


33 


37 


Swan/Kell's Angel 


0 


15 


Lyre Bird,/Carnaby St. 




14 


model 


✓ 


Hippies/Penguins 


1 


10 


Giraffe/Soldier 


64 


^ 1 



It can be seen that the children in the experimental gro’j.p 
did reproduce more producer pairings than did those in the 
control group* The differences are quite unevenly distributed, 
however, and they are not large enough to suggest that the 
programme had drajcatically realigned the children's prioi' associa 
tions* Nevertheless, according to a chi-squared test, the 
differences betv/een viewers and non-viewers shown in the table 
proved overall to be statistically significant at the 15^ level 
(meaning that they v/ould have occurred by chance only once in a 
hundred further replications of the study). It is safe to assume 
therefore, that the modest tendency for the viewers to conform 
more often to the producer's pairings was due to the programme's 
influence and not a chance result. 
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Further information can be gleaned from a more detailed 
Inepectior. of the table. It is clear, first of ail, that the 
differences between the experimental group pupils and the con- 
trols Were concentrated to a considerable extent on the pclicemaz^ 
judge pair aund to a much lesser extent on the swan/Heil'e Angel, 
bird/Camaby Street model and hippy/penguin pairs. Second, 
it is evident that viawers and non-viewers alike were far more 
inclined to group the policeman with the judge (the authority 
combination according to the programme) and the giraffe with the 
soldier (illustrating camouflage ir the programme) than they were 
to reproduce the other combinations that the programme had pre- 
sented. In the case of the policeman/ judge pair, the pupils' 
sensitivity to this conn^cticn was strongly reinforced by exposure 
to the programme. Most of the other associations, however, were ' 
initially quite novel to the children, and the results suggest 
i that the programaje succeeded in familiarising only a few of the 

experimental group viewers with the»J. 

A similar impression of modest change within a relatively 
stable context of prior associations emerged from a different way 
j of examining tne photographs grouped by the children . This con- 

sidered all the combinations they had formed, regardless of their 
conformity to producer pairings. The results are set out in 
Table II, which shows for each photograph which other photos it 
was most coononiy joined with in the children's groupings « 
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TABLE II 



* 

Most Frequent Combinations of Photographs Formed by Pupils 



Combinations 




Control Group 


Experimental Group 




N = 109 




N = 109 




• • 




N 




N 


Policeman WITH 


Judge 


59 


Judge 


87 




Queen 


35 


Queen 


80 


Judge 


Queen 


80 


Queen. 


88 




Policeman . 


59 


Policeman 


87 


Queen 


Judge 


80 


Judge 


88 




Ascot Dress 


36 


Policeman 


80 




Policeman 


35 


Ascot Dress 


ko 


Ascot Dress 


Carnaby St. 


61 


Caimaby St. 


5 ^ 




Queen 


36 


Queen 


4 o 


Carnaby St. 


Ascot Dress 


61 


Hippies 


61 




Hippies 


38 


Hell's Angel 


60 




Hell's Angel 


32 


Ascot Dress 


54 


Hippies 


Hell's Angel 


91 


Hell's Angel 


95 




Ccimaby St. 


38 


Carnaby St. 


61 


Hell's Angela 


Hippies 


91 


Hippies 


95 




Carnaby St. 


32 


Carnaby St. 


60 


Swan 


Penguins 


103 


Lyre Bird 


86 




Lyre Bird 


60 


Penguins 


82 


lyre Bird 


Giraffe 


71 


Swan 


86 




Swan 


60 


Penguins 


67 




Penguins 


59 


Giraffe 


49 


Penguins 


Swan 


103 


Swan 


82 




Lyre Bird 


59 


Lyre Bird 


67 




Giraffe 


ko 


Giraffe 


58 


Giraffe 


Lyre Bird 


71 


Soldier 


69 




Soldier 


70 


Lyre Bird 


49 


Soldier 


Giraffe 


70 


Giraffe 


69 



«> 

Photo pairings 



below 30 in number 



are not included 



in the table 
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Pcrhap.® the met .immediately striking feature of the table 
is the filmilarity shotm between the experimental ancf control 
group ccmbiTijalions. Some photograph pairs appear to have been 
virtually self-evident to the pupils, even tnough they did not 
correspond to a relationship indicated in the prograaime - e.g. 
Hell’s Angei/hippies (not Hell's Angel/swan as in the broadcast), 
Queen/ judge (not Queen/Ascot dress) and renguir.s/sv.an (not 
peVigutn5/hippiee)o Nevertheless, certain pairings were more 
frequently found in the experimental group o In fact, the pupils 
in this group tended to provide fewer and larger groupings thaa 
did those in the control group, the effect appearing almost to 
be one of a fomKition of clusters. The most obvious examples are 
the strengthening of relationships between policeman, judge and 
Queen and between Cairnaby Street model, Hell’s Angel and hippies. 
Ac examination of the reasons which the pupils gave for their 
groupings .may help to clarify what was happening* 

b . Coaparisor. of pupils’ oategories of dispiay and the 
pr oduc er ’ s ca terories 

Table III presents the results of an analysis of the reasons 
given by the pupils to explain their photograph pairings. Ten 
broad categories were sufficient to incorporate most of their 
statements, but some of tnem were broken down further into sub- 
categcries. 
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TABJJU III 



Catcr^orlRS of Display Formed by Pupils 



Categories 


Control 

Groups 


Expei’jment'd.. 

Groups 




N 


N 


A . Animals/Birds AnimalsAiirds ner se 


89 


.94 


Life in jungle/ 




1 

1 


A frica 


43 


' 9 


Life in water 


16 148 


A 


B, Camouflage 


1 


\ 


C. Clothes Clothes per se 


19 


' 17 


For fashion 


18 




*To show status 


loo 

vn 


11 73 


D, Authority *Display for authr 






ority 


1 


12 


Law and order 


oo 


34 46 


£• Importance Important people/ 


! 




events/ occasions 


44 


24 


F. Hippies - Hell's 


• 


- 


Angel , 


37 


18 


G, Aggression •Aggressive display, 


' 




fighting 


12 


17 


H. Attraction *Display for attrac- 






tion, courtship 


2 


37 


I, Conformity *Conformist display 


5 


13 


J, Narrative Situation described 


69 


38 


K, Other Unc].assifiable/ 






nonsense 1 etc® 


98 


64 



•Asterisk indicates producer's category 



The material is rich and complexj and only the more outstanding: 
findings can be mentioned here. First, the table drav/s attention tc 
a probable reason for the failure of the children to duplicate more 
of the producer's pairings in their ovm groups of photographs. The 
factor common to the most neglected combinations - sv/an/Hell's 
Angel, Lyre bird/Carnaby Street model and hippies/penguins - was 
the coupling of. a bird with a human figure. But Row A of Table III 



higblights the importance for children of explaynatiortvS of grouped 
photos in toms of bLrct/oniaal affinities instead of categories 
that relate the beharicur of birds or animals to that of human 
beings. It is also noticeable, however, that the experimental 
gr«up pupils produced fewer bird/aniaial explanations fnan did 
the members of the control group.* In effect, the programme had 
liberated some of its viewers from conceptual constraints set by 
bheii* previous patterns of association. 

A second important tendency is illustrated by Row J in th<» 
table. This shows that one of the cost common responses in the 
control group (exceeded only by references to bird^animal cate» 
gories) was a tendency to explain a combination by providing some 
kind of narrative account of what the photos showed. Some of 
these evinced a fascinating element of private fantasy Ce.g. , ’A 
man is walking through a great forest through wild swamps, and 
the lyre bird is standing in a swamp in the forest*, and ’While 
the swan is ploughing into the water like a churn, the penguins 
sit happily playing’). However, the number of such purely narra- 
tive accounts fell sharply in the experimental gTroap.** This 
suggests that the prograjcae had encouraged them to think more often 
in terms of definite conceptual categories that could embrace the 
photographs they had put together. 

Third, the table shows that the experimental group pupils 
relied more often on categories emphasised la the programme to 
explain whatever ecmibinatlons of photogrp.phs they had produced. 

* This difference was statistically significant at the 1 % 
level - i.e. it could have arisen by chance only once in 
a 1CX} times. 

** The difference in recourse to narrative explanations between 
the experimental and control group pupils was statistically 
significant at the % level. 
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One interesting example appears in Bow B cf Table III| which 
shows that the category of camouflage was cited by 4? of the 
experimental group pupils compared with only one member of 
the control group* Tlius, although^ as Table I nad earlier 
showed^ giraffe/so.ldier pairings did not increase after exposure 
to the programme, their association via the concept of cajiioaflage 
did* (In fact the experimental group children were much less 
inclined to associate these pictures through the notion of 'Life 
in the jungle’*) Other examples of producer categories that were 
mentioned more often by the programme’s viewers include display 
for attraction and display for status** 

An increased reliance on a producer’s category of display, 

however, did not invariably entail its application to that 

particular pair of pictures which had been used in the programme 

to illustrate it. This point xs demonstrated by the chart below, 

which summarises the main relationships that were found in the 

experimental group between pupils’ photograph groupings and the 

categories they had generated to explain them: 

Category Photograph Groupings 

Author! ty/Law and order Queen - Policeman - Judge 

Clothes •» to show status •* ** Queen •• Policeman - Judge — 

Ascot Dress 

- as fashion •• ** .• Ascot dress - Carnaby Street 

model - Hippies - Kell’s Angel 

Attraction ** .* .* .» *. Swan - Lyre bird Carnaby 

Street model - Hippies - Hell's 
Angel 

Camouflage * Giraffe - Soldier 

Aggression Swan - Hell's Angel 

Aniaals/Birds ** ** ** ** .* Swan - Lyre bird - Penguins » 

Giraffe 



* The difference between experimental and control group children 
in reliance on producer categories was tested for significance 

by combining all asterisked references iJi, Table III* This 
proved statistically significant the ^ level. 









It caul be seen that all tne producer's concepts are repre- 
sented in the cnaurt except conformity (which seems to be a less 
accessible notion to children than the others dealt with in the 
broadcast)* There is real evidence here of the impact of the 
pro^anone on the process of concept formation among viewing pupils* 

Nevertheless* the chart also illustrates the diverse ways in 
which Che posr-viewing thought processes of the pupils had trans- 
cended the bounds set by the programme content* For example* not 
only was the figure of the Queen added to those of tbi-i policeman 
and the judge to exemplify the concept of authority; but the con- 
cept itself was also extended to take in the idea of law and order* 
To the producer's examples of the concept of display for status - 
the Queen and Ascot dress - the children added these of the police- 
man and the judge* To the producer's examples of display for 
attraction - the lyre bird and the Carnaby Street model - the 
children added swans* hippies and Hell's Angels* In fact the 
persistent coupling by experimental and control, group children 
alike of hippies with Bell's Angela (not a producer pairing) was 
richly laden with diverse meanings - ranging from 'clothes for 
fashion* to 'love and freedom' ('The people in them are free and 
want to be free') and on to the notion of 'hooligans' and 'long- 
haired trouble-makers' who Indulge in protest and violence and 
get into trouble with the police* Such alternative categorisations 
probably reflect the influence of some strongly entrenched stereo- 
types* 

But the most striking general finding to emerge from this 
comparison of the producer's and the pupils' nmmner of organising 
examples of display into categories is that while the experimental 
group children revealed the influence of the programme on them in 



the greater frequency with which they had fomed categories 
correspondxng to those of the producer, their selection of 
examples to illustrate these categories still tended to be 
eubstant ially determined by their owii preconceptions of what 
things ’went together’ and of how they should be interpreted. 

This interaction between pupil presuppositions and producer 
objectives is evidently of great importance. It graphically 
demonstrates how the learning process is much more than tfJe 
rote acquisition of information packaged by someone else but 
involves an assessment of the provided materials against a 
background defined by the child’s previo»as experience and 
mental outlook. It euso underlines the importance of devising 
tests which can strive to measure the manner of tnis interaction. 

c.) vtuaiitative characteristics of pupils’ category types 

The last stage of the analysis of pupils’ understanding of 
the programme content involved an attempt; to examine the intell- 
ectual Level of the interpretations that the pupils had provided 
of their photo jjairiags. In conducting this analysis, their 
explanations were classified into so-called ’descrii)tive’ and 
’analytic’ responses. 

The term, analytic , was defined rather stringently as referring 
to those statements which showed that the pupils had discerned a 
meaningful underlying Idea ccxnmoa to superficially disparate images. 
The most obvious exBimple of this was the ability to relate the 
giraffe and soldier as representing the concept of camouflage. But 
instances of unusual categorisations , not suggested by the progranuae. 
were equally admitted, e.g., ’The birds are free and so are the 
hippies* (for penguins and hippies). Deserlotive types of responses, 
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on tne other hand* consisted for the purpose of this analysis 
mainly of assertions of identity ('They aire all birds’) and 
narrative explanations (’You sometimes get judges following 
when someone is crovmed’, 'They are in the street', etc*). 

In fact the above definition of an analytic response cut 
across some of the categories that had been used in previous 
analyses. For example, the concept of law and order qualified 
as an analytic grouping only when it went beyond mere narrative 
or situational identity. Many of the pupils' law and order 
groupings contained an authority figure together witn a hippy 
or a Hell's Angel. Such an instance was sc'.red as descriptive 
when the connection between the Images was merely situational 
rather than conceptual. 

The results of this analysis are presented in Table IV. 
Althou^ it is clear that most of the responses in all the groups 
were classified by these criteria as descriptive in character, 
there was also a significantly larger number of analytic responses 
among the experimental group subjects (20% of all classified state- 
ments compared with only 3% in the control group).* This suggests 
that the progranme had helped to stimulate more analytic thinking 
among its viewers than would have otherwise been the case. 

TABLE IV 



Frequency of Analytic and Descriptive Explanations of Pupils* 



r ‘ 

Type of 


Photo Pairings 
S3q>erifflental 


Control 


‘ r ' .... 

Totals 


Sespoitse 


Group 


Group 


■ — 


Descriptive 


346 


473 


819 


Analytic 


86 


15 


99 


, 





■■■II— 


II* '—I 


• ... ... 


432 


486 


918 



* The difference was statistically significant at the level. 

49 



2» Differences betv;een more and less privileKed types of schools 



The data presented above were further scrutinised to find out 
whether school background had influenced viewers' responses to the 
programme. At first the evidence seemed to point to two distinc- 
tions between the schools included in the study. One was a 
tendency for children from the more privileged schools to share the 
producer's perceptions more often (regardless of their placement in :j 
the experimental or control groups). The other was a tendency for | 
the privileged school children to show more signs of having been 
influenced by the programme (there were greater differences between 
the experimental and control group pupils). Both these points are 
illustrated by Tables V (dealing with the reproduction of producers' 
examples when combining photos) and VI (dealing with reliance on J 
producer categories to explain their combinations). 

TABLE V 

Number of Producer Pairings Reproduced by Pupils by School Background ! 





More 


Less 




privileged 


privileged 




schools 


schools 


Experimental group 


157 


71 


Control group 


117 


65 



TABLE VI 

Frequency of Reference to Producer-based Categories of Display by 

School Background 





More privileged 
schools 


Less privileged 
schools 


Categories of 
explanation 


Experimental 

group 


Control 

group 


Experimental 

group 


Control 

group 


Producer-based 


94 


22 


55 


7 


Not producer-based 




276 


155 


204 



A more detailed amalysis of the data, however, revealed the 



existence of big differences between the two privileged intake j 

! 

schools themselves. For example, the producer's Swain/Hell's 1 
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Angel pairing (to Illustrate aggresexon) was accepted by 
of the memoers of the experimental group in one of tnose schools 
but by no more than two individuals in the other* In fact most 
of the differences by school environment that are summarised in 
the tables steturaed from only one of the more privileged schools. 

It would clearly be unsafe to ascribe them to the influence of 
socio-economic background as such* 

This failure to produce consistent results withiri particular 
types of school is not untypical of research based oh samples 
drawn from individual schools. A similar result emerged from 
a study described in Chapter 8 below* It is as if the dimensions 
according to which schools are customarily classified (social grade 
of pupils, immigrant density, etc*) are secondary to the influence 
of some other as yet undisclosed dimension* At another point in 
this report the importar.ee of classroom atmosphere as an influence 
on pupils* reception of schools* broadcasts is stressed* It may 
be that there are also factors emanating from the overall ethos of 
a school which can occasionally override the influence of those 
other variables that research workers are accustomed to manipulate* 

Further research, leading eventually to a more sophisticated 
typology of schools, is badly needed if advances are to be made in 
class-room based research into the Influences that condition pupils' 
responses to schools' broadcasts* Until this is achieved, it is 
likely that uncontrolled variables will continue to produce such 
equxvocal reaults as those which frustrated the realisation of the 
second main aim of the present study* 
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3« Children’s interests and link-man preferencgs 

a) Farts of the programme found most inceresting 

1*he viewers of the ijrograme were asked to say which 
parts of \t they had found moat interestijog. A wealth of descrip- 
tive material was produced, giving rise to all the attendant 
problems (.hat a researcher must face when analysing children’s 
open-ended answers* Only one analysis has as yet been carried 
out on these dat-a* This involved an attempt to find out whether 
any particular parts of the programe were being singled out more 
often than the others as of special interest to the pupils. In 
fact this analysis did not disclose a consistent pattern of 
response) the liked passages being fairly widely scattered over 
the entire range of the programme’s content. Although the data 
are available for a more detailed analysis) this carciot affect the 
finding that in the case of this programne there was little con- 
sensus among viewers about the parts they designated as most 
interesting* 

b) Pupils* preferences for a. visible link-aan in 
contrast to a volce-ovgr technique 

Pupils were asked to indicate their preferences for 

a link.-oan rather than the voice-over featured in the prograaoe* 

They were instructed to indicate tnexr opinion by ticking one of 

three boxee, labelled ’better’, ’not so good' and ’much the same’, 

respectively. The majority of pupils expressed a preference for 

the voice-over teclinlque used in the production by indicating that 

a link-man would be 'not so good*. However, it is possible that 

these responses simply represented an overall 'vote of confidence’ 

in the skills of the production teM. Certainly this result must 

be regarded as limited in its applicability to other educational 
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Dlacuasion of the reaulta 

Tbe central findings of the study emerged from a sorting 
task* in which both viewera and non-viewers of the prograsiaa 
ware asked to group photographs whlwh seened to them to fit 
most suilabi*^. together and to give reasons for their choices. 
Exposure to the programme brought about a modest increase in 
the namber of producer pairings that were reproduced (e.g. judge/ 
policeman) t but there was also impressive evidence of riewer par- 
sistence with certain popular combinations that had not been 
associated in the programine (e.g. Hell's Angel/hippiee). An 
e'xaoiiation of the reasons given by the pupils to explain their 
groupings suggested that the prograome had been more influential 
at the conceptual level. There was a decline both in reliance 
on conventional animal/bird palra and in the provision of purely 
naurrative explanations of the groupings that had been formed. 

There was also a noticeable increase in the frequency of reference 
to categories which had been mentioned in the progranne and to 
soma extent a reorganisation of photographs to fit those categoriee 
(e.g. giraffe/soldier beroning an instance of camouflage rather 
than life in the jungle). Nevertheles6| both the concepts foraed« 
and the selection of examples to illustrate them. were more wide- 
ranging than the materials presented in the programme, and in 
general the viewers tended still to be governed substantially by 
their own preconceptions of what items went beet together. An 
explanation of these aspects of the pupils' behaviour can be tent- 
atively put forward along the following lines: 

It seems likely that pupils have at their disposal a limited 
number of alternative groupings and ways of categorising photo- 
graphs according to associations that are already familiar to them. 
Where the programme suggested an alternative that was already 
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evident to pupils, it stood a reasonable chance of influencing 
their responses. Where it etiggested an association that was 
unusual or alien to the pupils, they were likely to continue 
to opt for a more familiar grouping. 

It appears, for example, tliat animal-huznan pairings do not 
offer a familiar type of association for many pupils. Thus, 
only a small number of children were prepared to group hippies 
with penguins or a swan with a Hell's Angel after exposure to 
the prograone. The association of hippies and Hell's Angels 
was alread5’ prominent in children 'a minds and offered a human 
rather than a birdAunan basis for the meaningful coupling of 
images. Similarly, although the programme helped to attune 
some viewers to the concept of display for attraction, the 
possibility of pairing a swan, with a lyre bird tended to over- 
rule the producer's birdAuman pairing of a lyre bird with a 
Carnaby Street model. 

It is interesting to note, however, that the one animal/ 
human alternative frequently selected by pupils was that of the 
giraffe and a soldier in Jungle uniform, la this case a clear 
visual link was apparent between the two pictures and served to 
provide an acceptable combination for the children. Cn the 
other handy the idea that hippies drecsed alik‘. illustrated 
the notion of display for conformity was by no means immediately 
self-evident; in fact the children's ecivaents showed that they 
were more inclined to see them as individualists, fashion-setters 
or rebels. Thus, the category of conformity was firmly established 

only ® pupils, and the sequenoe hippies was more 
commonly associated by them v'lth other aispects of d.lsplay. 
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In contrafit to those passages of the programme which 
encountered pupil resistance, the links between policonan, 
judge and Queen represented clearly evident and available 
associations for children, and the effect of viewing the 
programme was to strengthen the connections between them. 

To the extent, then, that the programme provided familiar 
examples of a form of display, which could be seen by the 
pupils as clearly illustrating particular purposes of display 
(e.g. policeman/ judge: authority; giraffe/soldier: eaaou-> 

flag^, those categories were likely to be the more firmly 
eatablished. Where less familiar or less obvious examples 
were provided (e.g. hippies/penguins: conformity), the 

categories were IdLkely to be little in evidence in pupils' 
post-viewing organisation of the programme materials. 

These results - especially when considered in cunjunctioa 
with a further finding to the effect that few children had 
adopted a strongly analytic approach to the interpretation of 
the programme's materials - suggest that careful preparation 
and follow-up will be necessary if programmes like the one 
studied here are to impress their conceptualisation upon 
pupils and to shake them out of more familiar and stereotyped 
ways of looking at things. On the other hand, it may be 
considered that allowing children more freedom to interpret 
and relate sequences of such a programme in their own individ- 
ual ways, and for their own purposes, offers the best possible 
use of the broadcast. This is, finally, both a producer’s and 






a teacher's decision. 



Chapter 7 



STUDY n* 

YORKSHIRE TEIMISIOK'S MSETPIG OUR fningns 

The second 6ub8t^ultlal investigation of the project effltrged 
from certain prelinixuiry efforts that had been made early in the 
period of the Fellowship to pilot evaluation procedures in a 
trial study undertaken with Yorkshire Television* Before any 
research had been Initiatedy it had been decided to base the 
year's work on the upper age range of the primary school intake. 
This had the advantage of allowing research methods suited to 
secondary school pupils to be used« while at the same time 
enabling an examination to be made of the kinds of modifications 
that would be necessary to ensure that such procedures were 
adequately understood by younger ehlldren* Yorkshire Television 
then suggested that one of its series for that age range | Meetly 
Our Weeds , might serve as a useful focus of enquiryf since it 
seemed to members of the company to raise a number of questions 
about whether the most effective techniques of production were 
being adopted for. primary school viewers* 

This series was designed to form s basis for integrated 
studies in historyf science and geography* Its aim was to 
increeuse children's awareness of man's inventiveness and progress- 
ive mastery of hxs environment in various fields, such as Shelter, 
Food, Clothing, Communication, Calculation, etc* At a first 
meeting with the researcher, various problems that might merit 
investigation were suggested by the producer of the series, the 
Head of the Schools' Broadcasting Deportment, an 1 the company's 
Education Officer* It was provisionally decided to base a study 
on one of the broadcasts prepared for transmission in tbs Sunmier 



tenrif the wnole of wnich was being devotee to the thesie of 
Transport * The prograran\e selected for study, the opening 
one on tins subject, was concerned with tJie early history 
and development of transportation* It illustrated various 
forms aad uses of simple mechanical means of transport, 
inciuaing rciiers, wheels, boats and the trsvois* Filmed 
sequences were accompanied, by a voice-over commentary* As 
originaliv conceived, the aim of the research was tc examine 
differences an children's responses to variations ir the 
final sequences of the programme - according t.c whether it 
concluded with or without a summary ejnpJiasisi.r4t the main 
points of tne presentation, or, as a third alternative, 
with a song written around the theme of a peirticular set^uence 
ir. the programme* 

The Preparation of the Study 

Deciding the aims of the study 

The focus of .rssearch that was eventually decided upon 
for the main study was the influence of different styles of 
commentary on children’s responses to the programme* A 
number of considerations were responsible for this cnoxce of 
research topic, but primarily it stemmed from an inspection 
of teachers' cards reporting their reactions to other programmes 
in the series that had beer, broadcast in the previous tern* 

It was noticed that many of them referred to aspects of pro- 
duction which seemed likely to be inter-r elated* Some teachers 
considered that the programme' introduced new ideas and teaching 
points at too fast a rate for the pupils* Others said that the main 
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themea of the presentation were given insufficient enphasiat 
or that the relations between these essential points and 
subsidiary detail in the programmes were not made clear enou^« 
Another view maintained that the commentaries were spoken too 
fast and that the broadcasts contained too much 'talk'* 

It was soon evident that it would be difficult to vary 
any one of these features without affecting the others* For 
instances if greater emphasis was given to the main themes in 
a presentation! and to the way in which ideas in the programme 
realted to one another, then it would be necessary to reduce 
the rate of presentation of new points and to omit some of the 
less relevant details* One obvious way of emphasielng essentials 
in a broadcast would be to slow down the ^ed of speech in the 
conunentary so that a more deliberate, emphatic delivery was pro» 
Tided* Such a reduction in pace, and in the amount of detailed 
information presented, would presumably at least give the 
impression of their being less *talk* in the programme* Because 
of the difficulty of varying these different aspects of presenta- 
tion independently of each other, and because it was thought that 
their combined influence was most likely to make an impression 
on children's coa^rehension of the broadcast, a decision was made 
to study the effects of a revised programme incorporating all of 
these inter-related mod.ifieations* 

There remained a need to clarify what kind of difference in 
response might he expected to occur as a result of such a change 
in aiaumer of presentation* It seemed logical to infer that a 
style of presentation which aet out to assist viewers in separ- 
ating what was the central theme of the presentation from what 
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were more particular examples of the theme (or additional 
detail added for interest's sake) ought to result in pupils' 
attention being directed to the more general rather than the 
more peripheral aspects of the programme content* Ftom the 
producer’s point of vieWf an understanding of the programme 
could be said to depend on the viewer's ability to demonstrate 
such a grasp of its structure or its main lines of argument* 

It was deoidedf therefore , to test the hypothesis that 
pupils’ understanding of the programme content would be 
enhanced by a form of presentation which emphasised the more 
general ideas that the programme was intended to convey. 

Operationalising the aims of the study 

The burden of many of the teachers' comments about pro- 
grammes in the series appeared to be directed towards features 
of their connentaries* Consequently! an examination of the 
effects resulting from changes in the present style of comment- 
ary seemed to offer the soundest way of testing the validity of 
their arguments* It was also evident that the commentary played 
a crucial part in these productions* It was the essential means 
used for presenting fCMptual information; it was responsible for 
directing attention to those aspects of captions • films! and 
studio sequences which were relevant to the main theme of a 
programme; and it sought to establish the connections between 
different parts of the material* The decision to concentrate 
on commentary presentation also derived from practical con- 
siderations! however! for it was a relativaly cheap and simple 
matter to re-dub a new commentary over film sequences in a 
programme! whereas to re-structure an alreadyHiade production as 
s whole presented almost insurmountable difficulties* 
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The next step required was to prepare a revised coaunentary 
for the particular programme chosen for investigation! so that 
comparisons could bs made between pupils' responses to the 
altered version and the original presentation* It was also 
necessary to devise a questionnaire, which could help to 
ascertain whether any significant differences in pupils' grasp 
of the essentials of the programme content, stemmed from their 
eiqposure to the two different versions. In particular, the 
questionnaire would have to require pupils to discriminate 
between the more essential and the more peripheral aspects of 
the presentation* 

Finally, it was decided that it vouJ.d be interesting to 
try to find out whether pupils tended to discriminate between 
those parts of the programme which they liked best and those 
vhieh they considered most important, and that the questionnaire 
should also be designed to explore this* 

Determining the research techniques and materials to be used 

Attention was initially concentrated on modifying the 
commentary of the programme chosen for study* The first change 
to be made involved the removal of seme factual detail, which 
did not appear to contribute anything essential to the continuity 
of ideas in the broadcast* This provided time for the insertion 
of repetitions emi^sising the main themes of the presentation, 
for surrounding pauses and a more deliberate pace of delivery* 
Bepetltion was also used as a device to stress the thematic inter- 
connections between one part of the programme and another* This 
seemed important, as the programme was built around a number of 
rather striking film sequences (e*g* how an Aflrlcan made a canoe, 
a primitive man hunting, and the building of the pyramids and 



Stoa«h«nge)t which could readily ooaoand the Interest of ehildrent 
without their gaining an adequate grasp of why these examples were 
significant In relation to the history of transport. 

In addition! a style of writing was adopted which aimed at 
emidiasising important points by incorporating attentlon-eatchlng 
questions and by saKlng use of short* direct and pithy atatements. 
A considerable effort was made to render the oomentary as con- 
ceptually clear and uncluttered as possible! AAd a few key words 
or concepts) whose sense might hare been vagre or inconsequential 
to ehildrejif were also clarified and stressed. 

Once a new commentary had been created and dubbed* it was 
poaslble to construct a suitable questionnaire. The form decided 
on for this was a simple but potentially effective one. It was 
to list thirty statements* each apparently referring to a piece 
of information which had been given in the programme. Pupils 
could then be aaked to select fire statementa* which seemad to 
thoi to embody what were the most important points that the 
programme had made. 

The questionnaire was compiled by first choosing 20 state- 
ments from the principal sequences of the programme* in such a 
way that* for each such sequence* there was an equal number of 
items regarded as central to the main theme of the presentation 
and Items considered peripheral to that theme. These latter 
statements referred for the most part to details of how various 
modes of transport were constructed or operated. To these were 
added five statements of the most general kind* which summarised 
the thematic structure of the presentation j and five statements 
which were regarded irrelevant to the mala theme* or ineorreet. 



T'liis created the following breakdovm: 



statements 



15 ’Centra] 




pai’ticular statements (C .) 



general statements 



P 



15 'Non-Coi 
statements 




10 



5 



peripheral statements (P) 



irrelevant statements (Pir) 



Exajuples of these statements of what the programme 'was about' 
are: 

'How -men learned to move very "heavy weights on land with 
primitive kinds of -transport. ' (C^) 

'How the Egyptians used hundreds of men with rollers to 



'Hov/ the Egyptians used palm oil to make their rollers 
move more edsily.' (P) 

'How the Great Pyramid was the highest building in the 
v/orld until the Eiffel Tower.' (Pir) 

At the end of the questionnaire, a question was added asldng 
the pupils what they had liked best in the programme. 

. A sample of pupils could now be dra;m from classes in the 
appropriate age range and be randomly divided into two comparcxbie 
groups, one viewing the original presentation while the other sav; 
the modified version of the programme. A statistical analysis 
could then be made of the extent of the differences occurring 
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between the two groups in their choice of more cc-ntx’al or 
peripheral statements. 



Classroom procedure for the study 

A particular aim of the classroom procedure planned for 
the study v/as to remove as far as possible from childrens' 
minds the idea that they were being 'tested' and to put them 
in a frame of mind vAiere they would react to the experimental 
situation as spontaneously as possible. It was also necessary 
to ensure that the pupils properly grasped what was required 
of them in using the questionnaire. V/ith these objectives in 
mind the following procedure was worked out: 



Before running the programme, the Education Officer (E.O.) 
was to put the children at ease by chatting with them, and then 
to tell them that he has a nev/ programme on tape that he wants to 
show them, and that afterv/ards he v/ould like to find out what 
they think about it. After the programme has been run the E.O. 
was. to say: 



I'm sure when you get back to school, your friends 
who didn't see the programme will probably want to 
loiow what it was all about. Nov;, 1 want you to 
imagine that one of your friends has just asked you 
what the 'Programme was all about. I want you to 
tell him what you think were the most important 
things in the programme. 

In a moment v/hat I'm going to do is to give you some 
. papers, which have a number of things v/hich were in 
the programme v/ritten down (hands out questionnaire). 

On the papers you've got, there are thirty things 
which were in the prograirime. First of a],l I v;ant 
you to read these thi’oug-h, and then I v;ant you to 
put a tick next to the five things which you think 
v/ere most important in the programme. Remember, 
you can only put five ticks. 
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Wheo pupils AT« fisishedi the 2.C* to ask there to indicate 
that part of the proeramine which they liked best. 

It was decided that in order to establish sufficient 
control over the viewing environraenti pupils should be bused 
into the Sorlcshire Television studios. Two offices were made 
available, with a Sony VTR in each, so that pupils could view 
the programme simultaneously, but in a slightly staggered 
fashion, giving the B.O. sufficient time to move between the 
twe rooms, and to give instructions at the beginning and end 
of the tapes. 

One of the important lessons learnt from the previous 
pilot experiment had concerned the strong and diveeae influences 
that individual teachers could exert upon their pupils* responses. 
A re-run of that experiment had suggested that significant differ- 
ences in response, which were apparently due to variations in the 
form of programme presentation, were in fact almost certainly a 
product, of different moods created in the classes by the individual 
teachers, and of the comments they had made to the children. 
Consequently, it was decided that for this experiment the children 
should be brought all together to the studios, to avoid differ- 
ences in prior activities before viewing the programme, and in the 
time of day at which they took part in the research. It was also 
agreed that, so far as possible, only the S.C. and the researcher 
should be present with the children at the time of viewing. 
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It can be seen that much attention had been paid to the 
need to achieve a high degree of control over the experiaental 
situation. Unfortunately, not all contingencies had been fore- 
seen, and this control was uitderroined cv am equipment breakdovm 
shortly after the Education Officer had started the VTR for the 
experimental group and had left the room to give instructions to 
the control group. The failure produced a ’broken* image on the 
screen, and for a short period the experimental group pupils 
were in a state of bedlam. Vfhen the fault was rectified and 
viewing was resumed, the contrast between the seriousness of 
the control group and the tminhibited reactions of the experi- 
mental group was quite marked. The findings presented below, 
therefore, cannot with any degree of certainty be ascribed to 
a single cause. They may have been due to the manipulation of 
the coanentary, to the influence of the breakdown, or to on 
Interaction of both influences. Nevertheless, some attempt 
to sort out the factors involved can be made, and it is worth 
pointing out that the likely consequences for pupil learning 
of just such an incident as occurred have much Interest iJ 
their own right. In fact sane of the results of the experiment 
can be interpreted in the light of some earlier work which had 
been carried out at the University of Leeds Centre for Television 
Research on pupil reactions to educational broadcasts after 
attempts had been made to induce differential moods in pupils 
and in social atmospheres p r^^vaienr in the elassroon. 
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THE EXECUTION OP THE STUDY 



Summary of the aitas 
Aitto of the tVtudy ; 



Sub.iecte : 

Research Haterials t 

Control Condition ; 

Experimental 

Condition ; 

Method of data 
collection; 



i design of the study 

To test the hypothesis that pupils* 
understanding of programme content would 
be enhanced by a form of presentation 
(style of commentary) which emphasises 
the more general and central, ideas which 
the programme is Intended to coneey* 

30 upper primary school children, aged 
10-11, Pupils randomly divided into 
control and experimental groups. 

Two versions of the first prograome in 
the series, Meeting Our Needs: Transport , 

Version I, the original presentation. 

Version II, the original presentation 
with a modified commentary, (The 
experimental condition was further com- 
plicated by VTR failure and a consequent 
change in pupils* mood,) 

Pupils to be required to select five 
statements out of a list of 30 , indica- 
ting which ones they considered most 
aptly described what the programme was 
about. 



Pupils also to be required to state 
tdiich part of the programme they liked 



' I'letljod .of Pupils' oVioice of stntcmentii (:.,n iiio^i 

analysis ; 

representative of the prograir.ne ' ;j 
meaning and ns indicative of ti'.e pai't 
they liked best) to be oxjuflined for 
the frequency with v;hich they derived 
fi’om tlio following categories of rela- 
tionship to the progrmnme's thoinntic 

sti’ucture: Central - General niid 

1 

Particular; and' Non-central - 
Peripheral and Irrelevant. A comparisoji 
to bo made betv/een the choices of 
experimental and control group pupils 
and the statistical significance of any 
differences between them to be calculated. 

The central findings of the study are surivnarised in Tables 
VII and VIII. Table VII shov/s that the control group pupils 
(viewers of the original programme) chose significantly more 
central statements than did the expei’imental group members 
(who had been exposed to the modified commentary). In other 
words, the expectations expressed in the original hypothesis 
were reversed. Further light is shed on this outcome by 
Table VIII, which shows that the differences between the grouj.)S 
concerned the frequency with v/hich the most general of the 
central statements and the most ir'^elevant statements, respect- 
ively, were chosen to express the programme's theme. For t’le 
other types of statement (particular central ones and perip-ieral 
but relevant ones) the frequencies of selection by the groups 
v;ere virtual3.y identical. Noticeab3.e is the relatively h:gh 
proportion of general statements chosen by the control group 
and the correspondingly low proportion chosen by the experi- 



mental £;r'OUj.); and tho exact revcj':j'.il oi' t’lii; pattern In their 
selection of irrelevant statomonpp. 



TABLE VII 

Number of C entral and Non-Central Statement s c hosen b y O illron 
in each Group to Express Wliat the Proryamnie v.'as About 





Statement? 






Central 


Non-Central 


Total 


Control 

Group 


86 


64 


150 


Experimental 

Group 


65 


CO 


150 


Total 


151 


149 


300 



(Maximum possible number of choices = 150. Nimiber of pupils 
in each group = 50) 

p 

= 5 088 - significant at the 5?^ level 



TABLE VIII 

Frequency v/ith v/hich Pupils in Control and Experimental Groups 
Selected Aiternati.ve Kinds of Statements 



Statements 


Control Group 
( original 
corrmientary) 


Experimental Group 
(raodif'i.er. 
commentary) 


Total i 
1 

1 

1 

i , 


Central/ general 


46 


25 


• 

71 ! 

I 


Central/particular 




4 o 


80 j 


Peripheral/relevant 


44 


45 


j 

89 I 
» 


Pex’ipheral/irrele- 

vant 


20 


40 


60 ' 


Total 


150 


150 


300 I 



(Maximum possible number of choices = 150* Numbo-i* of p'.’.pils 
in each group = 30) 



An examination of reyponccs to tlie question as'cins; v.'hich 
part of the programme pupils liked best indicated a high 
de^i’ee of similarity in the answers of the two groups. But 
whereas, in the case of the experimental group, there was a 
fairly close correspondence between liking a sequence of the 
programme and endorsing a statement derived from it as express- 
ing what the programme was about, the control group pupils, 
on the other hand, more frequently distinguished between 
their liking of a sequence and their judgements about its 
centrality -to the theme of the progi’amme. The implications 
of these findings are considered further below. 

Discussion of the results 

An important clue to an understanding of these findings 
stemmed from an analysis of the particular items that at one 
and the same time were a) most heavily endorsed by the 
experimental group as pertinent to the programme's theme and 
b) belonged to the sequences that v/ere particularly enjoyed 
by both groups. These included such statements as: 

Hov/ an African can hollow out a canoe from the trunk 

of a tree v;ith a stone axe. 

How schoolboys showed hov/ the Ancient Britons were 

able to move huge stones to build Stonehenge. 

How stone-age men made weapons out of bones. 

Hew transport advanced v;hen man discovered the wheel. 

In fact these items came from those film seouences in the 
programme which had proved in the earlier trial study to be 
the most compelling and enjoyable for pupils and which almost 
certainly included the visual i.iaterial that v/as most striking 



and memorable for the;ri 



1 
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One posbible explanation of the outcome of this atudyi 
thenf is that it reflected certain consequences of the revised 
and more deliberately paced commentary which the experimental 
group pupils had received. Giving them as it were, an extra 
'breathing space’, this may have enabled them to devote more 
of their attention to the visuals, their interest even being 
heightened by a style of commentary that tried to 'point up* 
the significance of the pictorial illustrations. Thus, these 
children may have been encouraged to regard the visuals they 
liked as also relevant to the programme's central message. In 
other words, the revised commentary could have acted on them 
in unanticipated ways. 

Such a factor, if it was involved, may have been reinforced, 
secondly, by the unintended variable at work in the study as it 
was implemented - that of a mechnical breakdown which visibly 
altered the climate in which the programme was received by the 
ei^erimental group children. It may be useful at this point 
to digress euid mention that previous research undertaken at 
Leeds had already suggested that children's mood could be an 
influential variable in determining some of their responses, 
even overriding at times certain features of production expected 
to be important. For example, in one study of a documentary 
programme, mood was deliberately manipulated in advance. The 
members of one group were given to imderstand that they would 
see an educational programme and be tested on it afterwards, 
while those in a second group were invited to watch 'a few 
films* in a more lighthearted spirit, the documentary being 
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preceded by two To.ni ar.'d. Jerry cartoons. Both groups c'.:;.ipletcd 
identical questionnaires after having seen the docuMcsrtary, 

The results shov;ed tiiat when tlie cliildren were asked to desci'jVc 
v/hat sort of prograrmne the documentary waf;, more 'educational* 
responses were given by those in the first group (cog. 'It told 
you about . . .') while more 'personalised' ones toidcd to come 
from the second group (e.g, answers beginning, ' It made me think 
that • 0 .). Although in this particular case there was no 
difference between the groups in information gained from the 
commentary (based on a knov/ledge test), one can well iimagine 
how in response to other programmes differences of mood could 
result in the paying of differential attention to different 
aspects of a production o 

From this point of view, it seems a reasonable guess that 
when the experimental group pupils were freed by the mechanical 
failure from the constraints and av;e of coming to a television 
studio under research conditions, they responded simply by 
enjoying those parts of the programme they found most attractive, 
rejecting any more serious approach to the experience. This 
explanation implies that, in contrast to the ojcperirnental group, 
the members of the control group had concentrated- careful.1y on 
the main theme of the programme and had taken seriously t>ie 
task of stating v;hat the most important ideas in it had been, 
distinguishing these from the features they had particul.aiuly 
enjoyed. The experimental group, on the other hand, had con- 
centrated on those aspects of the programme of most obvious 
fascination to a child audience, also reflecting this in tberir 
pattern of selections from the items intended to e:cpress 'what 
the programme was about. 



( 




68 - 

All this XB consistent with the possible role of yet a 
third factor* The qualities of the original eosunentary may 
well have been responsible for the more 'correct* performance 
of the control group* That commentary had been composed in a 
style derived from adult documentary broadcasts and made few 
concessions to the school audience* But it is possible that 
children of this age respond positively to such adult-type 
commentaries* For example, the complexities in the lemguage 
of the commentary may have stimulated them to strive for an 
understanding of what the programme was about, and that effort 
could in itself have led them towards a better appreciation 
of its central themes* If so, the more adult commentary 
might have enhanced rather than distracted from their close 
interest in and comprehension of the presentation* Some 
support for this interpretation can be gleaned from a further 
consideration of Table VII and VIII* The facts a) that 5T% 
of the control group item-selections referred to * central* 
statements and b) that only 13516 of thwn mentioned * irrelevant* 
ones, suggest that they were certainly not unduly confused by 
the original commentary* To this extent the results do seem 
to lend some justification to the producer *s original choice 
of commentary style* 

The most likely explanation is that all three factors 
touched on above - heightened attention to the visuals in the 
modified version, the e3q>erimental group* s more frivolous 
approach to the whole exercise, and the effectiveness of the 
original commentary - were to some degree Involved in the 
pattern of results that emerged from this esqperiment* But it 
is very much to be hoped that a replication of the study can 






be undertaken after further diseusaions with those who were 
Involved In Ite execution* Such a replication could be of 
some considerable importancei since the implications of the 
findings reported here transcend the particular programme 
that was examined and touch on some issues that are quite 
fundamental to an effective usage of educational broadcasts 



Chapter 8 



STUDY Ills 



« 

GRAMDA TELEVISION'S CUH NEJGHflOUDS 

The two studies outlined in the foregoing pages were 
concerned chiefly with the cognitive dime;if>ions of children's 
responses to schools' programues; tho project's third major 
investigation marked a new dopartura by venturing into the 
realm of attitude change as wall. Undertaken In collaboration 
with Granada Television, it v;as based on the company's Our 
Neighboiirs series, which is intended to iatroauca 10-13 
year-old children to questions of race relations by acquaintil^f 
them with the cultures of foreign peoples who have settled in 
Britain. The particular prograstmo in the series that was 
singled out for research v/ae Oiu* Nclghhours from Pakistan . 

The Preparation of the Study 
Deciding the aims of the study 

The choice of series and programine for the study emerged 
from discussions held over a period of several months between 
the researcher and tho Education Officer of the Schools' 
Broadcasting Department of Granada Televis?.oa» It offered a 
topic for investigation that vrats of direct concern to the 
Department, so little beuig Iciown about the effects of broad- 
casts intended to influence English children’s perceptions 
of members of other racial groups. The goal of the Our 
Neighbours series has been described by tho company' as one of 
encouraging 'appreciation and tolerance of people of different 
creeds and races, now living in Britain, through an understand- 
ing of their background and way of life'. Tho programme notes 
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add, ‘What is coamon Ic us all will be stressed; what is 
unique will be explained*' In further dtscussions with 
aeirbere of the Department, however, in v/hich questions for 
research were considered, it was recognised by all con- 
cerned that there was no guarantee that the senes would 
achieve Its object of fostering favourable appreciations 
of other racial groups among white pupils i in fact the 
possibiiaty was entertained that the series might equally 
well reinforce existing prejudices or even stimulate new 
ones (by creating an awareiiess of racial differences not 
previously noticed)* Tfie study’s general aims were thus 
virtually pre-formulated: to ascertain whether or not 

ex^sosirre to a programme in the Our Neighbours series promotes 
among its viewers a more informed understanding and sympathetic 
appreciation of the ethnic group it describes. This would 
involve, it was supposed, on the one hand, a greater recog- 
nition of similarities between themselves and the group 
depicted, and on the other hand, a greater readiness to regard 
as acceptable those respects in which the group was perceived 
nevertheless to be different. 

The specific programme. Our Neighbours from Pakistan , 
was selected for investigation partly because it referred to 
an immigrant group which was clearly an object of prejudice 
VO some sections of theco:;:tur,lty. The broadcast seta out to 
let children see what life is like in Pakistan etnd then to 
show them how one Pakistani family has settled down in Britain* 
One noteworthy feature is the fact that the presenter herself 
is a Pskiataml (as are all the other speakers in the programme)* 
Another is its strong emphasis on Islamic religious and cult- 
ural customs and how they mould the everyday behaviour of 
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Pakistani people* Some aspects of Pakistani life which are 
dealt with in the progranrae include: the making of chapatis, 

the frequency of prayer, eating habits (with some stress on 
the practise of eating with one's hands v/hich are invariably 
washed before meals), the closeness of extended family ties, 
the strict upbringing of children, fashions of dress, leisure- 
time relaxations, the importance of religion and the diffi- 
culties for Pakistanis resident in England of learning a 
new language and making other adjustments to British ways. 

It was appreciated that the study could not aim to chart any 
of the longer-term developments in pupils' attitudes to 
Pakistanis that might result from expos'ure to the programme* 
Prom the standpoints both of research feasibility and of the 
company's practical concerns, it seemed important to study the 
more immediate reactions provoked by the programme, for it was 
those that teachers, receiving the broadcast, would have to 
contend with and strive to use creatively in the classroom 
afterwards* The intention, then, was to discern the immediate 
post-broadcast state of mind in which the programme left pupils, 
and to discover how far their understanding of Paklsteuii ways 
and their opinions about them differed from their pre-broadcast 
outlook* 

Operatioealising the aims of the study 

As will become apparent from a consultation of the text 
below, the decision to base research on Our Neighbours from 
Pakistan entailed exploration of a quite intricate field of 
responses* So far as possible, the questionnaire that was 
eventually drawn up sought to do justice to its complexity* 









One area of Investigation concerned the pupils' 
reactions to the presentation os a whole - whether it 
impressed them favourably and perhaps pre-disposed them 
to accept its message* To put those reactions in perspective, 
however, it vmis thought useful to explore some of their atti- 
tudes to t-lovision as a medium as well - whether they were 
inclined to regsird it in general as aii authoritative and 
credible source from which to learn* 

A second line of enquiry started from the pupils' 
levels of prior knowledge about Pakistan and Pakistanis, 
from which could subsequently be gauged the amout of factual 
infomatioa v;hich they had acquired from the programme. 
might provide the basis for a more informed understanding of 
the customs and beliefs that Pakistani people adhered to* 

But it was agreed, thirdly, that the most significant 
reactions to the presentation would consist of children's 
cpiniens about and attitudes towards Pakistanis themselves* 
Such reactions might include their evaluations of Pakistanis 
in tenvs of their conformity to the children's stamdards of 
what counted as proper behaviour in certain spheres, the 
extent to which they tbou^t that Paklst6UiiE should conform 
to Snglish habits and customs, and how they felt about 
mixing with Pakistanis* 

The alas of the study called for a before-and-after 
design, and it remained to decide how a sample of children 
should be chosen* Previous research undertaken at the 
University of I<eicester Centre for Mass Communication Research 
by Paul Hartmann and Charle Husband had suggested that the 
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( density of the immigrant population within their areas of 

residence was a crucial factor in influencing the racial 
attitudes of English school-children. In their word*: 

• • • among white working-class secondary 
school-children, at least, prejudice cowards 
colotured people is more common in areas of 
high immigration than in areas of low immi- 
gration, and in schools t/ith appreciable 
nximbers of immigi’ant children titan in schools 
with few or none. The data shov' that immi- 
gration into an area is more strongly related 
to prejudice than is perccnnl contact in school.* 

Consequently, it was decided to base the study on two 
samples of children, drawn respectively from schools located 
in areas of high and low immigrant density, and to compare 
their reactions to the programme. 

Detemiaing the research techniques and materials to be used 

It was decided to collect evidence from the sample 
members by means of a questionnaire composed entirely 
of forced-choice items. The children would be given a set 
of printed statements and asked to react to each one by 
placing a tick against one position on the following five-point 
scale: i^rougly agree; agree: don’t know: disagree; 

strongly disagree. This would facilitate a sensitive measure- 
ment of cJianges in knowledge and opinions following exposure 
to the programme, although some produeexMs feared that the scale 
might prove too dlffieolt and confusing for the children. They 
eventually accepted this technique on the understanding that 
it trould be carefully explained and illustrated to the pupils 
before they completed the questionnaire. In the event there 
was no evidence that they had experienced any serious 
difficulty in responding to the scales. 

Paul Hartmann and Charles Husband. The Mass Media and Racial 
Conflict*, Race , Vol. XII, No. 5, 

f 
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The quest lomxaire included statements of thjpoe dliTerent 
k-indfl, which were interspersed, however, to counteract 
possibilities of response set (a tendency to fall into me 
habit of answering questions According to one pattern only)* 

The first set of 12 statements, which were expected to elicit 
pupils’ views about the nature of tclevisinn as a credible, 
iin -jA’' and information-conveying medium, differed in 
their pre« and pose- viewing versions* The former referred 
CO television as a medjum in general, while the latter referred 
specifically to the prograaune about Faicistanis as such* Most 
ol these statements were so worded that the pre- and post- 
versions referred to similar attributes* For example, a pre- 
viewing statement to the effect chat, 'You can see v/hat people 
are really like from TV' , was changed for the post-viewing 
situation to, 'You could see what Pakistanis are really lilie 
from the pregrarame' * 

The second and third sets of statements were identical 
in their pre- and post- viewing versions* The second set 
consisted of 14 statements, each of which referred to some 
piece of information that had been presented Ir. the programme* 
Some of these items were correctly stated - e*g* ‘Most 
Fakistamis are Muslims who follow the prophet Mohammed’ - 
while otherc were put in an incorrect form - a*g* T-aki- 
stanie are not very religious people’ • 

The third set of l6 stoteoents elicited a degree of agree- 
ment with various value tiom of Pakistanis, often couched 
in the form of conparieons with Englishmen or English customs* 
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SoToe, for cxaunpley were straightforwardly comparative 
e.g. 'Pakistanis aro usually as clean as Snglish people’. 

Others enquired whether Pakistanis should conform to 
English customs - e.g* 'Pakistanis should dress the came 
as English people'. Yet others referred to various aspects 
of relations between the races - for example » whether 
Pakistanis 'are ordinary people like us', whether English 
people tend to treat Pakistanis 'unfairly', and whether 
mixing between Pakistanis and English people was a good idea* 

Tii0 samples of viewers were drawn from four Manchester 
schools - two of which were located in areas of hi^ immigrant 
population and two in areas with few immigrants. In order to 
hold the influence of social class constant, all the schools 
came from predominantly working-class areas of the city. The 
individual schools themselves were selected accorilag to 
these criteria by an official in the Manchester Education 
Authority who Is in charge of special work with Immigrant 
children* It was then agreed with the Heads of the schools 
concerned that at a certain time a number of pupils would be 
asked to complete the pre-viewing version of the questionnaire; 
and one week later the same children would be shown Our 
Neighbours from Pakistan and given the post-viewing queation- 
r.aire to fill in* Before its use in the foixr schools, however, 
the pre- version of the questionnaire was piloted in a Bradford 
school, where the pupils were invited not only to complete the 
form but also to discuss the statements Included in it with 
the researcher. Some of the items were modified as a result 
of this trinl. 

it’ 

<j 
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Detormininr: tho cl aGsroor:i .rroooduro 



The Granada Education Officer, who wau barjod in 
Manchester, agreed to oversee the classroom runnin^j 
of the study. She was to be assisted by someone from 
the scliool concerned - eitlier a Hoad or an individual 
teacher - v/ho v/as to be instructed not to comment on 
the questionnaire items or to influence the children 
in any way. 



The procedure for introducing the Education Officer 
to the children was intended to luiable her to appear so 
• far as possible incognito. The aim was to avoid an 
association of her in the children’s minds either Waoli 
television or with immigration (which might have 
influenced their responses) and to. encourage them instead 
to regard her as a disinterested interviev/er. The tent 
of her introductory remarks v/as as follov/s: 



I have been going ai'ound different schools 
in Manchester finding out what children 
think about some matters which are very 
important for people living in England 
today. 

1 v/ant to find out what each of you per- 
sonally thinks about those things, V/hat 
you say is going to be quite private - it’s 
nothing to do with school, I v/ant you to 
try and be as honest as you can and to tell 
me what you really think. 
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The question.': I'm /■oin,';; to aslc you in 
this school are maii'.ly about two thinji'E 
- v/hat you think about television, and 
v/hat you feel about Pakistani people 
livinc in Encland. 



Now I v/ant you to ooen your books to 
the first page. Vv'h.at is written tlere 
is a number of sentences. They are all 
about things which other people have said. 
I want to find out if you agree with them 
or not. 



Now look at the first sentence. It says, 

'Pakistanis are not as herd-working as 
English people'. Underneath it says 
strongly, agree, agree, not sure, diagreo, 
strongly disagree. I want you to put a 
tick under just one of these things. If I 
strongly agreed with that one, I would tick 
it, like this ... ( VJrite on blackboard. 

Elaborate until it is clear that pupils 
fully understand). 

V/hen she returned to the schools the second time, the 
Education Officer spoke to the pupils along the follov/ing 
lines: 

• 

Last week I came to see you, to ask you 5jome 
questions about matters which are important for 
people living in England now. Do you remember 
that some of the questions were about Pakistani 
families in England, and some v/ere about televi- 
sion? 

Today ‘I'm going to show you a television programme 
about Pakistanis, and when i^s over, I'm going to 
ask you some questions again to sec how you feel 
about things. 



I 



V. 
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^ filii jp overt ard books handsel out 

Wow turn over the page. Pm going to read out 
the sentences .Like last tunc, .>nn by ote, and 
remeciV.er, ea-.-ri tine you har« to put a tick 
underr.t'st n say >#h>Jt you Ihin.k about that 
quest loc. 

The Execution ci the Study 
SxTunar’.y of the aims and design of the study 



Aung of To investigate (3/ pupils attitudes towards 
th e St’».dy ^ 

TV as a medivni ilron whic-h to learn, and whether 
their reactions to the presentation of Our 
Weighboure from Pakistan were favourable or un- 
favourable; (b) the extent to which pupils gained 
factual knowledge from the progranme? (c) the 
extent to which pupils* prior opinions about 
Pakistanis were subject to change in a favourable 
or unfavour.abie direction after viewing the pro- 
gramme; and (d) to compare the responses of 
pupils from high and low density immigrant areas 
in these respects. 



Subjects: 106 pupils, aged lO-li years, drawn from four 

schools in the Manchester area, two from a high- 
iiamigrant-deneity area, and two from a low-density 
area as follows: 



High Density (H^) s 19 

High Density 2 (H^) = 27 

low Density 1 (Lj) = 52 

Low Density 2 IL^) » 28 
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Method 0 / Adnu.mstration of a questionriaxre. requiring 
data 

xu llectior; -' the registration of agreement or dxsagr'fceraerit 
With a number of stAtemonts on a five-point 
scale « 



Methods gf Comparison o^' strength of agreemenr/disagree- 
data 

analysis : ment. by pupils on items befo’-e and after 

viewing the prograncne. Comparison of strengtn 
of agreement/'disagreement on i corns between 
pupils from schools located in areas of hign,. 
and how immigrant density • 



Results of the study* 



The investigation produced a wealth of evidence about 
the reactions of children to race relations themes* Only 
the main findings will be presented here* but the data would 
lend themselves to a more detailed analysis - particularly 
of Inter-relationships between some of the key variables 
represented in the study* 




* 

The results set out below are presented without recourse to 
chi-squared tests of the statistical sigruficance of differ- 
ences between pupils- responses to v3urio\i£ queetiortt before 
and after viewirqt* Much of the discussion turns on changes 
of response to a large number of quite specifi-'. items, for 
which a certain statistical model of afialysie had originally- 
been envisaged* This would have involved an inter correlation 
of question answers^ and a grouping of the responses by cluster 
analysis^ in ordur t.o reveal the main dimensions cf opinion 
along which the pupils were reacting to what they had seen. 
Although some of the work required for such an analysis was 
carried out, it could not be completed In time for inclusion 
in the present report. With the eiccepfcion, then, of an 
analysis of var-lence (see Tacle XII below), which aimed to 
trace the interaction between programme influences and differ- 
ent schools in the acquisition of information from viewing 
Our Neighbours fror Paitistan . f.*''' -iiscuseion is based upon a 
detailed uuniicative aruilysis* 
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1 • Opinions about television and about the progfaigr et 

Our Ngjghbours from Pakistan ~ 

The children's general impreosiono of television as a 
medium of communication are summarised in Table IX» The 
positively and negatively worded questionnaire items, have 
been distinguished \n the table so as to facilitate its 
interpretation, and the individual statements are presented 
in an order that corresponds to the degree of agreement that 
was registered with each one. The table refers to all the 
pupils wno took part in the study, for there was no evidence 
to show that density of innnigration in the pupils' area of 
residence had influenced any of these reactions to television 
as such* 

The table suggests that although the pupils may divide 
fairly evenly over some attributes of tolevision, by and 
large the majority of children give it their confidence* 

They were apparently most impressed with the information- 
conveying power of television* Thus, agreed that they 
could learn how other people felt about things from watching 
TV (the largest percentage to agree with any positively 
worded statement), v;hile 7C5^ denied that 'TV can't tell you 
anything you didn't know before' (the largest percentage 
rejecting any negatively worded statement)* Other responses, 
however, signified n more sceptical spirit, 7^ agreeing that 
•You can't always believe what they tell you on i’V*, 53% 
stating that they would not change their minds because of 
things seen on TV, and 46% denying that, 'You can see tdiat 
people are really like Sroro TV'* On the other hand, tele- 
vision producers were credited v/ith having good intentions. 






( 
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5596 agreeing that the roediu« usually tries to be ’fair to people’ 
and 3 ^ agreeing that you could trust T/ ’when ct shows you ordin- 
ary people telling you about themselves' o 

TABLE IX 

Opinions about Television as a Medium (ore) 



■ Positively worded statements 


Agi*ee 


Don't 

Know 


Disagree 




^ % 


% 


96 


I often learn how other people feel 
about things from watching TV. 


62 


25 


15 - 100% 


I often hear people on TV laying exactly 
what I think about things. 


' 37 


17 


26 


. TV programmes are usually fair to people. 


55 


24 


22 


i TV tries to make up your mind for you 
. about things. 


; 52 


16 


32 


You can trust TV when it ^ows you 
^ ordinary people telling you about thraiselves. 


52 


16 


32 


TV can show you the right way to treat other 
‘ people. 


49 


23 


23 


You can see what, people are really like 
from TV. 


39 


15 


46 


i 

Neisatlvely worded statements 








You can’t always believe what they tell 
you on TV. 


75 




14 


I would not change my views because of 
anything I had seen on TV • 


33 


29 , 


1S 



TV prograjanes don • t try to improve things 
In the world. 

The people in TV programmes don't always 
Inow what they are talking aoout. 

TV can’t teU you anything you didn’t 
know before. 



40 

39 

20 



23 

22 

10 



38 

39 



N a 106 



JC 






70 



( 
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If anything, the pupils in the study felt even more favour- 
ably disposed towards Oar Neighbours frovi Paicistan as a prograjiune 
than towards television as a ffledlisn. Their rear tioivs to a ntunber 
of specific statements about che programme are presented In Table X. 
These suggest that the children were particularly impressed with the 
broadcast's credibility. Seventy four per cent; professed trust in 
thv programme for its use of ordinary people to show what Pakistani 
life was like. Fifty nine per cent denied that its aim was merely 
manipulative - 'just trying to make me change my mind about Pakistanis’: 
Sixty five per cent vouched for the truth of what was 'said In the 
programme'. The pupils felt almost as positively about certain 
other features of the broadcast. At one and the same time they 
thought that it had faithfully depicted English reactions to Paki- 
stanis (d^) and was trying to be fair to the Pakistanis themselves 
(61^). The children also seemed to find the programme informative, 

669^ agreeing that it had helped them 'to understand how Pakistanis 
feel about things'. And 659^ agreed that it had made them think tliat 
’Pakistanis should be treated the same as English people'. All this 
suggests that many children are likeiy to regaurd as acceptable the 
efforts of schools' broadcast producers to use television to promote 
more enlightened race relations. Of course this is not to say ainy- 
thing at this stage about the actual effects of such use, and in 
this connection it is interesting to note the hint in Table X of the 
exists of reservations in the minds of some viewers about tbs 
likely impact of the progranne they had seen on relations between 
Pakistanis and 1 iglieh people. Only 369^ disagreed with the nega- 
tively worded proposition thav, 'This sort of programme won't help 
people of different races to get on better with each other*, while 
as many as 4^ said that they did not know. 

67 
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TABUS X 



Opinions about; -Oiir Neighbors from 



PAkistan* as a ProjtrasuBa 


(post) 






1 

Positively worded statements 


Agree 


Don' t 
Know 


Disagree 




% 


% 


% 


You could trust what the programme said 
becauae you -• •r ordinary Paktstania 
telling you about themselves* 


7 ^ 


19 


8 a 


The programme has helped me to under- 
stand how Pakistanis feel about things* 


66 


27 


8 


The programme made me think that Paki- 
stanis should be treated the same as 
English people* 


65 


26 


8 


The programme was trying to be fair to 
the Pakistanis* 


61 


29 


9 


You could see tdiat Pakistanis are really 
like from the programme 


58 


25 


18 


The programme was just txTlng to make 
me change my mind about Pakistanis* 


20 


22 


59 


Negatively worded statements 








The programme has not changed my views 
about what Pakistanis are really like* 


31 


31 


38 


This sort of. prograone won' t help 
people of different races to get on 
better with each other* 


20 


44 


36 


The people in the programme didn't . 

always know what they were talking 
about* 


17 


32 


51 


I don't believe everything they said 
in the programme was true* 


10 


25 


65 


The programme didn't tell ce anything 
I didn't know before* 


10 


17 


73 


The programme didn't ihow you how 
English people feel about Pakistanis* 


9 


7 


84 



N > 106 
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2* Knowledge gain 

Our Neighboura from Pakistan was not only well-rece5*'«d by 
the children i it was aleo highly effective an conveying informa- 
tion to then about Pakistani customs and ways of life* Never- 
theless, there were inter-school differences in the extent of 
such knowledge-gain, the pupils from one of the high-density 
schools having been out of step with the children from the other 
three schools* In presenting the results in Table XI, therefore, 
this particular d.lstinctlon between the schools has been pre- 



served 



TABLE x:: 



Parc(?ntages of Correct Responses tn ilnforr.ation Itemg 
before and after Our Neighbours frog Pajtiijtem 

Three Sc.iools ’ One High Density 
Corob loed (N = 37) Srnool (N = 19) 
Before After Before After 







% 


% 


% 


1 • There az*an ■ t any modern 
cities with factories and 
offices in Pakistan* 


26 


74 


16 


58 


2* Pakistanis don't bring up 
their children very strictly* 


28 


70 


16 


32 


3* Most Faiustanis come from 
country villages* 


31 


77 


69 


69 


4, Pakistani families don't 
allow giTis and boys +o go out 
together* 


22 


91 


37 


89 


3* The people in Pakistan are 
mostly farmers and fishermen* 


30 


75 


37 


58 


6* Pakistanis cover their arms 
and legs because of the climate 
in England* 


40 


51 


21 


4? 


7* Pakjjstanis eu:-e not very reli- 
gious people* 


47 


77 


47 


58 


6* Most Pakistanis are Muslims 
who follow the prohet Mahommed* 


25 


76 


74 


63 


9* Pakistanis must eat special 
meat because of their religion* 


30 


89 


95 


95 


10*Pakistani boys and girls 
always agree with what their 
parents think. 


25 


a*" 


11 


11 


11 •Pakistani children in England 
have to learn to speak three 
languages* 


21 


74 


16 


53 


12«Paklstanx8 eat chapatis made 
from flour and water* 


25 


92 


74 


100 


13 *FUcistanis don't think edu- 
cation is very important* 


28 


78 


16 


47 


l4«The word Muslim means a 
person who disobeys God* 


20 


73 


5; 


68 
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The ialle demonstrates how numerous and substantial the gains 
in factual information after seeing the programme were* For example t 
there wei'e large increases in all the schools in the numbers of 
children giving correct responses to items about urban .life in 
Pukistant the country's occupational structuret parental discipline* 
the language problems experienced by Pakistani children in this 
country, and Pakistani attitudes to education* 

The table also hij^lights two sorts of differences between the 
schools* First, the pupils from the one senool that is dealt with 
separately in the table showed an initially higher level of coirect 
information about Pakistanis at the time of the pre-wiewlng test* 

!niey were more knowledgeable, for example, about various features 
of Pakistani meal'-time habits and religious customs* But second, 
some of the knowledge gains recorded by the pupils in that school 
were less substantial than those which were registered in all the 
other schools combined* 

Notes about the schools supplied by the Granada Education 
Officer helped to clarify eomu of the likely sources of these differ- 
ences* It transpired that was the only school in the sample with 
a large enrolment of immigrants in its classes (as distinct treat 
simply being located in an area of lii^ immigrant settlement)* In 
fact 70 of its 170 pupils were immigrants, of whom as many as 48 had 
come f^rom Pakistani homes* In the other school in a high immigrant 
area there were oxily 17 immigrant children out of a total enrolment 
of 213 pupils* Moreover , school 1 !.^ was the only one in which deli- 
berate instruction about the Pakistani way of life had been provided 
in assemblies cn the subject* There was also a Pakistani teacher on 
the staff who was responsible for special English classes* All this 
suggests that in this Investigation, in contrast to the Leicester 



study mentioned above | contact with Pakistani culture inside the 
school had played a more important port In discriminating pupil 
responses than had a merely residential immigrant presence. 

The teaching given on Pakistani culture in school 
together with the greater amount of contact between English children 
and their immigrant peers, is probably sufficient to explain the 
higher level of initial knowledge found among the pupils in this 
school. It is also possible that the incidence of higher ia-school 
contact helps to account for this school’s lagging knowledge gain. 
Inspection of the individual statements involved suggests that the 
ones oa which after viewing the pupils were giving fewer correct 
answers in comparison with the children in the other tliree scliools 
were chose to which they could have been responding in light of 
their experience with immigrant peers rather than In the light of 
information provided in the programme. Examples of such items are: 
'Pakistanis don't bring up their children very strictly.* 
'^klstanis are not very religious people.' 

'PaldLstanis don't think education is very important.' 

Finally, the statistical significance of each of the main 
patterns in the findings that has been singled out for eomnent 
above was confirmed by the results of an analysis of variance which 
are presented in Table XII. Row B shows that the amount of overall 
knowledge gain would have been achieved by chance on only one 
occasion out of a hundred. How C shows that school H^'s initially 
superior level of information would have oceiarred by chance on only 
one occasion out of 20. And row D shows that the pautem of post- 
viewing change in knowledge level was significantly different among 
the pupils from that recorded by the other children (it 
would have happened by chance on one occasion out of a hundred). 




TABI£ XII 



Azui.lyBiB of Variance in Correct Responses to Information 



Items cefore a n d after the Pragraaape 

f . • " 





Degrees 

of 

freedom 


Sm 

of 

Squares 


Variance 


Variance 

t 


Slg. 

level 


A. Between items 




1802.27 


138.64 


.325 




B. Between pre and 
post 


1 


15798.20 


15798.20 


36.83 


P<i 01 


C* Between schools 


1 


2038.^0 


J 38.40 


4.752 


F<i 05 


D* Interaction B x C 


1 


10325.28 


10325.28 


24 . 3 ? 


PCjOl 


Residual 


59 


16729.21 


428.95 


- 


- 


Total 


55 


46693.36 
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3 . Attitude change 

It was in its examination of attitude change that this study 
yielded the most complex and ir.tereeting findings of all* To 
understand ' r/«i the pupils* views developed after seeing Our 
Neighbours from Pakistan * the evidence must be considered iu stages « 
corresponding to three fairly distinct types of opinion and attituds 
items on the quest ionxialre* These requlredi firsti an assessment of 
Pakistanis in terms of eez^in valued character traits that were not 
directly dealt wlUi in the programme but ^ich might have been 
influenced by it; second, an evaluation of Pakistanis in terms of 
characteristics that were specifically covered in the programme; 
and third, expressions of opinion about race relations as such - 
that is, about relations between Pakistanis and English people* 

The children* s responses,before and after viewing, to the first 
set of statements, those which compared Pakistanis with English 
people for their honesty, friendliness, intelligence and diligence, 
are presented in Table XIII. Since the opinions of the children 



4 
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again differed appieclably from those of other pupils, they 
appear S9pa’"ately in the Table. The results tend to suggest 
that prograouDee like Our Neighbours from Paicls^»•B ^ may promote 
more favourable images of the peoples they describe, at least 
amon*; those l -':; ; •'ho attend schools which receive onlj' s mall 
numbers of immiR;rant children. The pupils from the combined 
schools recorded increases in favourable evaluations, ranging 
in magnitude from 9% to 1951^, on three of the four items con- 
cerned (for honesty, friendliness and being hard-working). In 
school however, the children's Initial impressions of 
Pakistanis were more favourable than those found ir the rcrabined 
schools; but after seeing the progranme the proportions of 
favourable evaluatioriS fell on three of the items by between 1096 
and It is not that these children had become more unfavour- 

ably disposed towards Pakistanis, however; instead they showed 
more uncertainty of judgement after seeing the programme, the 
don*t know responses having increased by about 2.C^ on each item. 
It wais as if for them the programme had precipitated certain 
possibly underlying doubts without inculcating any distinstly 
negative impressions. 
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TAUi-'J XIII 

Kcopo.i;;rG of pr.iul.-.-. to otatemonl.a ovaluatin.r; chnractoi;if.tics of 
; K kistani.G, pre and poat vicwinr; 



Statement 




Three Schools 
Combined (N s 8?) 
Ag'cJ! Don't Disagree 
Know 


One High Density 
School (N = 19 ) 
Agree Don't Disagrer 
Know 






% 


% 


% 


% 


cf 

70 


% 


Pakistanis ;ire as 


pre 




26 


29 


68 


21 


11 


honest as English 
peopl.e 


post 


55 


36 


9 


58 


42 


0 


Pakistanis are as 


pre 


. 55 


31 


l4 


79 


5 


16 


friendly as Eng- 
lish people 

*Pakistanis are 


post 


7^ 


15 


12 


68 


27 


6 


usually as clever 


pre 


ho 


15 


45 


47 


26 


26 


as English 
people 


post 


ho 


29 


31 


32 


47 


21 


*Pakistanis are 
















as hardv\rorking 


pre 


53 


18 


29 


32 


42 


26 


as English 
people 


post 


62 


22 


16 


42 


26 


32 




These statements were worded originally in a neg :ive form in 
the questionnaire, but in order to facilitate inver retation 
of the table, they are treated here as positive in recording 
the direction of pupils' responses. 



Table XIV presents the pupils' reactions to a second set of 
statements, v/hich v;ere intended to gauge the influence of sequences 
in the programme that had dealt v/ith certain specific aspects of 

' I , 

Pakistcini behaviour and customs. These items involved comparisons 

i . ■ 

of Pakistanis and English people in terras of cleanliness, manner of 
dress and eating liabits; how far Pakistanis should conform in 

I . . I 

» M. . 

■ r* ■ 

these respects to English ways; and to what extent Pakistanis 
seeraed overall to be 'like' or different from ordinary English 
people. The responses to these items provided detailed and 
revealing insights into the v/ays in which the children had inter- • 
preted tlie programme content in the light of their ovm prior 
expectations and standards. 
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Pakiatn.nia .•.u'o 
UGuo.liy ay 


pro 


39 


16 


15 


63 


16 


clean as Ingiinh 
people 


pos i; 


1 

1 

1 

1 


•1 ■? 


1.3 


Ih 


21 


1*1 

Palcia tenia cat 
prcnorly lih.c 


pro 


1 

1 

1 


2-1 


'i5 


37 


' ) f 


people 


post 




17 


53 


21 




Paki^-vtaniG are 
as wc!Q-droGsod 


pro 


b.? 


2 6 


22 


53 


?/\ 


0 3 Ln.[jMr>h 


post 


70 


15 


15 


68 


• 


poo]?lo 














PakicUinis in 
1 J?n^3anu should 
cat tk*o saiao 


pro 


'i5 


• 8 


h? 


21 


i6 


\'Jhiy acj — 

people 


■ post 


H3 


15 


52 


. 2c 


2'- 


Pa]>:ir>tani:5 f 

should dress ' 


pre 


hi 


15 


ho 


i6 


hi 


the S'l-rriO as 
Idnrjlish ]'>oople 


post 


28 


'10 


62 


37 


52 


It's better if 
PakiL 'cr.riis "'n 


pre 


hb 


17 


37 


hi 


25 


b:ipl'..:.vi k.O}) 


post 


31 


2-5 


?h 






their o\:n ways 














Paliistanis are 
ordinary people 
like us. 


pre 1 

post 


82 

85 


7 

2 


-12 

15 


68 

55 


1 a 
26 



Thi.s Ktatcmont v/aE v/orded or i ginally in 
que5'.ionri:;irp,bv.t j.n order to facilitate 
taVjlo, it i.G treated here as positive in 
of pnpil rorr,on''eE . 



a ne.fTo.tive form : n ■* 
ir.terprcto.tion of z: 
rGcording the diroc 
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'I’hf moat otrj fjtuixiif'a cu.’om to h.'ivc arj..'.'M' from o.m; 
Qoquonoo in tho j-.ro^ramnio, in v.;iich the i:,.':’;boro of a I'akir/taivi. 
family are shown at a table Jiavinc a meal. They a.re aeon oatli';; 
traditional food v;ith their finqers as is tlioir ci’stom. At the 
boginnirp of the aequcnco, t.he father of the famiJy is shovm 
carefully v/ashin['; his hands, and the religious £:i/;irlflcance of 
this practice is explained. One impressive rx{:n of L!ie impact 
of this sequence emerged from responses to tho si^ tomont, 'p£i!'l- 
stanis are usually as clean as English pcoj'le'. Taking all the 
children in tho study (without regard to the schools they attended), 
opinion on this point before viewing was evenly divided, having 
agreed with the statement, hZ having disagreed and 1? been imsure 
out of a total of 106 respondents. But after seeing the progranmio 
79 pupils (or nearly three quarters of the sample) had accepted the 
statement. It can be seen from the table, however, that this devel- 
opment v/as‘ almost entirely concentrated among the pupils attending 
scliools that had few immigrant ’Children. The respondents from 
school were already aware of tlie characteristic Pakistani 
concern for cleanliness. 

However, the same sequence in the programme is responsible 
for yet another, equally important, finding, which runs in a 
counter direction. In response to the statement, 'Pakistanis 
don't eat properly like English people', the pupils were at first 
divided in outlook but tended to agree with it. After exposure to 
Our Neighbours from Pakistan , this tendency was accentuated, the 
proportions agreeing v/ith the statement having risen from to 
535'^ in the combined school group and from ZC'f/o to 47/o in the single 
school. In this respect, then, the prograjmne had apparently 
influenced pupils in the direction of finding Pakistani behaviour 
less acceptable than before in its divergence from Engdisli ways. 

c ^ 



Table XIV also shows that, so far as dress v/as concerned, 
the progranfflo had exerted the more favourable type of influence 
instead of the unfavourable one. Small majorities agreeing before 
viewing with the proposition that, 'Pakistanla are as well dressed 
au English people’, increased to nearer ?(% afterwards. This 
suggests that the specific piece of information given on PeJti- 
atanie eating with their fingers had struck a negative vein ■'n 
pupils' thinking which was not paralleled by the programme's 
illustration of differences in dress. 

It is one thing for a programme to affect viewers' awareness 
of similarities or differences between peoples in the customs 
they practise. It is another matter to determine whether it has 
influenced their impreasion of the desirability of conformity by 
the members of an immigrant group, to the host population's 
ways. Should Pakistanis in England eat and dress, cay, like 
English people do? Responses to the two qusstionnaire items about 
these matters highlighted yet again the importance of the I’tmigrant 
composition of the schools concerned. In the Ic'v dcrsity schools 
combined, there were quite big swings ^Z2lo end respectively) 

towards disagreement with statements insioting or Palcistani con~ 
foroity to English eating habits and standards or dress. The 
influence of the programme on these pupils, then, had been ts^waxds 
a greater acceptance ol cultural diversity. In school however, 
the shifts went the other v?ay - with a decline of ^CYo in the numbers 
rejecting a demand for confomity in eating habits and an increase 
of among those wanting conformity in dress. It was as if the 
programme had heightened the sensiti^'ity of some of the chil:'ren 
in this high density school to cultural clashes that might bo 
latent in their situation. This possibility was underlined by* 

C«. 
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rcrt.o;';. ^ . |.o ■•nt. [ .. . •ir-.’' ^ v- 

lil:c c[‘ in the co.r, '.in'e i nhc^. ’ . .. i 

accoutr'd ;ji:d;n:;'aent" bo th beL’oro :y\'\ i-'['cr Lnr •}' 

tho })ro[;r.i;;iUO :u:d rci.;noc tivL*‘.L.y) o j‘ho 

chilchrt'U Trcn r>c.hr)C;l il^ , ho'/ovc-r, v/oro .’Iu: n :incljn(.d l.o 'v;;'- *’ 
with l.lij."*; propoo.i t.-toii boUorrlv'jid ((oh' dono r-c.O; :w;:i 

af toru*:u\Jcj the ir'opor Lion l5i epi'coment '’cl.l iurldKei' i.o pd., 

oinrilar cro;. ;.>-currentn o ffectod t):o juipilLi* .. 

tc a direct c-tatci.iont about the dcoirability of 2 \'.c:iat. .! t,. 

(worded & bettor if Pa]a.:..t'Anio in Iiiiir.'.land l:cu‘p to lho:'r 
vraysOt It can bo .e.-on ft-om t.lio tabic tint in the co”’:hir;ed 
school f>;roup dica;^rcc:nont with this proposition fell fro;v. 3;*/- 
before viowinr;^ the pro[:rarn!nc to nftorv/.Lrds. Cnee ’.I'piin, to. 
tolerance of divcrcity had aj)parcntly been strengthcr.od. But\ i i 
school oqDOsurc to the programme precipitated a di'anntic luoyo- 

j 

ment into the 'don't knov.'' catcf;orj of reoj^'once (from 2.0.^ to 5^-); 
involvinc 3- corresponding decline in the miiubers opting- for 
tolerance from to These changes seem substantial enou;“h, 

but even they mask the total amount of shifting that actuai].y '!'c 
place. This point is illustrated by Table aV , v/hich sho’..'s that 
only 59 of the 10b pupj.ls in the study had Iicld to f'-'eii- .'re- 
viewing opi-nions about racial conformity after seeing the progr:o'.;. ; 
Of the f? pupi.ls (or kk^/o) who had changed their minds, 1b had 
shifted tov/ards agrec’ment ;/ith the statement, seven tov;: rds d'S" 
agreement and 22 towaxds uncertainty. Thus, while it appears tt.-i 
there v/as virtual. ly no change in the total number of pupils agree: 
\;ith tne state; .out 'Ji'-) before /md 50 o.ftcrw..>.rds) . in l-act eight.-,. 
pupils had shifted towards agreement and 1? away from agre.'-anh;. . 
Pucli a high dogroo both of change and of variability in jiupils • 
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i’c.;)'.onro lattf.'rii.-. v/:'.:.; tyi i.c'il of t’v.'ir ..■n'lor.'.'o.rcr.l;.'.; of all, Uio 
i::ri , ro . ;.:i 1 i. ' ‘;;:o ; ; ; . ' r\' 1 : *! 1 : : .‘<u'r»yi lo 

ii::vAnr) or con rorrn.L by 'uvJ .'ncc rolnbionn. . Thin on ‘ :o.]bo bh:it 
hho iiror r* :nnio hnri nrounod a j^'n'ticu.l'Arly corrnl.ox not of ro- 
an U.onn a.mon:; r.r.iny of bho nlu.lt! ron onnoGod to ito 

TABIil XV 

Xi nboro oj r.url ln orinionc ro:n Lrod st ^blo o r chnn^ ;’ Hi, :.tnd 

n»'.o ; ■ • vv,-^ I; : 'V ■ ()[' ' [; ;• ' ' . i. ^ ' t ; * ’j I; ’ . ' hoibov if 

h: h:i>.h:anio in j jn,nd kcoo 'fn :.\Lr ov/n v;m;/g^ , ninj- :ind ronb- vion-gn g 
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Finally, four (luestionraire itcma probed thp j,nfiuence of the 
prof^'romino on th.o jAipils^ opinions about mutual relations between the 
races. The trends of response to the individual items, v/hich are 
s/iovm in Table) XVI, are as diverse as the previous fjndinf;s li-ave by 
now led us to expect* First, there i.s in all schools a widespread 
and mainly uncaan^iod opinion to the effect that, 'Pakistariri are 
Gomctiinos trcc\tod unfairly by Fn^lish people** The children's 
percepbions of a * common hiJ.Vi'uiity * , sliarcd bebvvoen themselves and 
Paki.ot:nnis, is unnistakcable in responses tc this and other items 
with a similar r.o'-.nin^: (e-f;*) *Pakisb- .rlc are ordinary people like 
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uo')» Second, at the pre-viewing etago tliere waa an equally 
exleneivo endoraoment of the proposition that, ’Fakistants 
should be treated the same aa English people’. But after 
seeing the prograinme there was a distinct tendency in all 
the schools to veer towards a 'don’t know' position on this 
Item. In the one school with a large immigrant population 
this was raauiifested in a sizeable increase in the proportion 
of 'don’t know's - from before viewing to 53% afterwards. 
This may have reflected an increased awareness oh their part 
of differences between Pakistanis and themselves after exposure 
to the programme. Third, the more positive side of the pro- 
gramme’s influence is illustrated by reactions to'te statement 
that, 'Pakistanis are as easy to like as English people’, where 
agreement in the combined schools went up from 28 % to 43%. 

The pupils registered no change of opinion on this item, 
however, h'%Jr.£: <» stability of judgement which may have been 
due to their more frequent day-to-day contact with immigrant 
peers ^ they eilready knew whether or not they liked Pakistanis, 
and no television programme was going to change their minds 
about that. ’ 
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TABL^ Jf'fl 
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Pupi l a to m onts o;i Muta ^l P.^l ntiom Vot v’g ^n 
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This statement was vrcrc^’ed originally in a negative fern in the 
questionnaire. but in order to fPcUJ.taio .•>.nti:*pretation of the 
table, it is treated I’': re ncriiive in recording the direction 
of pupil responses* " 

But perhaps a lep;’ stat :~?nt the cr.n vrhich maintains thaV 
Paki.stanis and Eaglieli e-lsali r' t 'ai:: teg'-thsr*. On/this 

y 

y 

item the programrr.e prev csiitrrry 'hji'ts acccrCirg to' the 
immigrant densities prevalent in tie cjhools conco/vind. Pre- 
viewing responses <:o ^ etitrrer.i; i/rrs f'drlv' evenly divided 
between agreement an.! Tior 'riiv-h pupils tending to 

favour a somewhat i.iore pusitivs rttitudo toi’axds ii. tor -racial, 
mixing. After seeing the pro.gram. hwer-er, the proportion 
supporting- nixing wont up in the ccnbinid schools from to 
52 Sb, while the aq'iivalcgit pi'r-portio.n in the singls school fell 
from 575^ to general the numbers faroarir.g inter-racial 
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mixlru: nay stioz rather lev; las do the porc-.T.rfegca nayirijr thzvt 
PaiKistari^! ore as likeablo a* Enp/uish people ) ir r*-iat. ;or to 
the f hi IdTt’r. s apparent utceptance of a ehorad hunuo'.'-y totwocn. 
thencel'/ce apd FaKt6t«ni.s. app-ars to be beir.p expressed 

is group TesliPpi ac if to caj , ’We can see that you are 
ordinary hanan bcirgs who ought aot to bo treated differentiy, 
but you are not one of ur..'- 

Disc usa ion of the results 

Tne ir^iJi findings and i-nplicat ions of the s+udy nay be 
summarised as follows: 

l) Pupils tn all the schools demonstrated a willingness 
ro accept the '.'redibility and good faith of the programme, which 
they found informative ai.d affecting. This reflected both positive • 
feelings about the programme itself and theLr generally rather 
favourable orientations to the information-providing power of 
television. 



2) Pupils in all schools rivy a ci^^cn f leant iy higher proper'- 
tion. of correct responses to inforna.ion items testing their know- 
ledge about Pakictar. and rolcistanis after «ie> ing the ^ “ogramrae. 

It was also found, however, that pupils in one of the high density 
echoolsCH^) (Consistently produced r. differ :-nt pattern of responses 
from those of the children in the otbor three schools, tending to 
exhibit a considerably higher level cf initial knowledge but 
showing fewer gams after seeing tho progre.mme. Tins senool con- 
tained a much higher proportion of imnigrant children than did the 
other schools and was alee characterised by the greater amount of 
play-contact which its English pupils appeared to have with Paki- 



stani children. Pupils in this school had also been given some 
lessons on the Pakistani v/ay of life. It was considered that their 
relatively less successful test performance after seeing Oi^ 
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froT P^K:.Jrt an r,aj /av»^ :t itadorr.) to recpomi 

wit-n : •^f^rcr.rv tc t'"*;o.r eyxoi*\*in:K o, Pa^.ir. :rx 1.iror: m i;ot:coi 

■*'T ■“■ " " 

Afi.iiv&i'i oC r .::3poti6^?t; (."■ ar.otr.or :•'•■: v : ':'r :>i th«; qjeS't i^r:- 
nair»=’, rv Vii/ in,v p'jpj.is ov>j>uat,e rcrso •; h in ; ^Oi■l j.ca d' 

PdKaiiu. ronfiriDsd thai tre r'l-v’pondcp.' t, wcr'^ to divide 

a^To; dn.’ir to tne? ctiri.auv c;' irjr.if:nr.t •'. tiaJ,.ire-; ir: tr;- dcnool rariier 
thar; thf density ci rritTiij'j^-.ts in the area of th.'; .-ity where the 
srnool wa;. io.oted. './fierena scnool H, pupiLc typiialiy displayed 
ratht^r favouracle pre -v iew.uip a’.titudso tc„cirdd viKistAnis, hut 
p 05 t- 7 iev,ir.g opLtions whirr, reacted towards tr.t 'don't. Know • CHce- 
gpry of response, childrer, in ail the other schools expressed 
in.it iaily loss positive impressloae of Pakistanis v/hicn moved in 
the direction of more favoarab.le opinions after exposure to the 
prcgraaime. TVjis suggested, that v;here local factors did not 
Interfere wit.T'^eir impact, programmes ir; the Oi^r Neia;h.bours 
mould 'nad a potential for enhancing ^luter-rari&l understanding, 
t The implications of the diti.sion ic response betwceri schools can- 

not be ignored, .'ipwever.,. aiid are fart.ke'' discussed below. Of 




course, it should also be borne i;i mind, that school H. 'on- 
tri-butedi only '•9 pupils to tnc sample-. It vculd obviously be 
important, therefore, to replicate this study in a larger number 
of schools with siinil:ir characteristics in order r.o csrablisc or 
disprove rhe validit.y of the distinction between schools which 
has proved so prominent ir. th^ results of thin study. 

K) I'he most revealing findings of the .study emerged from 
responses to a set of statements which sought, to explore whether 
Pakistanis were seen as conforaing to .TJnglish children s behav- 
ioural expectations and how far English pupils were wiiiing tc 
accept non-confomity iiv Pakistani conduct. The extent and 



O 



corspi^xity ;,f the po3* -viewirt' chnr.pcs, thar, wt^e .st ircul'it^d 

5ijg, ■;-:£' tha'. t-ho pupalt.' .tij re:-ipcnac>'i :o rnr* progrririiue Ui a 

rv.^ativf-iy pc-rconai and t-xplorapory Qavier and r.?’. jj.ir ^r. 

t-ermc or i>t‘^rr-otypefJ group feeUngQ ar.d chin-nrig. The most 

d/'.i'tmi' d-voiop^.ents reiateu to 3 o>equonc#- ic rh-: yorreum*- 

TJlusProtar.g Paoiuianz ipt.'al- i noa custurRo» Ar'ter vi-jwvng a 

6»- >T.ioh Gcrciirei 'h-? lirportanco of c l-'r-j.'rL.Tj.oo' to 

Fokisrar.^o. a laog- r.uraoor 0 : pur^ij..:; were to ha^'e 

ehxt'ted toward^ agreeraenr with the propc:=i.tior. Pam-staais 

are ur-iaily Hv~ rlean as ilrqr'.ics people. There :.t sor.e evidenre 

fro.T research mat tr. fazt oieanlinesa (or at least 'not 

Rffieilxng') may te an unportaat factor in the readiJieso of 

children to accept one another m school.* However, the sans 

sequence produced a strong negative shaft in opinion about 

whether Peutistanis 'eat properly like English people* - due 

apparently to the pupils having been shewn tremters of a Pakistani 

family eating with their fingers. Thus, tiic showing of two 

intimately related aspects 01 Pakistani culture had resulted in 

changes of opinion jn opposite directions, one seemingly more 
✓ 

positivi and the other more negative. 

Caro is called for in interpreting tne latter development 
in TWO raair. resoects. First, although the showing of Pakistani 
eating habits has emphasised a difference between tne rates which 
has impressed itself upon children, it would be superficial to 
regard these reactions y nt -ti -.■rncio'* of increased 

prejudice. If most Eriglish children have been taught to believe 
that eating with one's fingers ratner than a knife ar.d fork 

m 

Keith G. Powiey, ’.Social Heiatiocs between British and Imniigraint 
Children’, Educational Research, Vol. X, Nc. 2, ?967-^, 
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cun.-.r. If f :'i' h i ■T.aar . •lU ;i:“ u!U'<. if p/aM6hA0l«; , th^>n 
at r,' cc...'.nr ily fci.owi tha:. . .-I'ccjrdLii.-f, fc t'vjir u;;lTlnging, 

P-tMi .• uo mO' pr^iT oriv. r’>-(.r' rna:^ oi viev ther*:* 

iC Adj'roAg c f h,'\ \n ;.nt; cr.iidrr;:’^ rtfCpOA-'se. That 

;a/i ror^ivti itTio w.:th •: r.i r.h.ir$d haTKa^ty 

ronbrr: n* jp'^ coo ro: Ci-iy by tn<? aaswyro*^ oi 

the "a-rip.ic ‘.0 c or. tr." ^on’ia ir o bat also 

bv Lh'‘C3*: appo:.';t * rv;r.9rK:;. of !Iroul,'\ ;?Inrra: 

Wr aro ail ^h? ba* cin rvll havo rjvon 

ruIt'G ior li. ir.i?? Tnjr-? ig only ori*> 
w^^.y OI ohiiorer., bit ♦br-rr? T.any 

:iiflerer:f for.'?.? of ro.rr ia/;;*: . Thoro 1 g only or.o 
viy of r .0 3rir.^^::»ent, bj^ thero aro a 

huroreJ difi^rrent. v^yn of dowr. to table# 

Th*^r^ If-' only ore vay k^epiry v/aro not a 
hurJred different fashions of dr-^GB ^ « • Eacn 
r:an loves the lai/n o! inr^ ior.d ’.yhere he was torn#* 



Sextond, it is vruo tnat the erophasising of differences 
ir. the prcgrc>™e cUti ne^n: to help to breed a sense of un- 
certainty amoTi 5 children in the sinp;lo srhooi with many 



inipi^rfxp.r pupils acout: the desirabia i**;/ of intet'-ra-'^ial mixing 
and of treatia;^ Pakistanis l:k3 Engii/,;h people #/ V/h-le this was 
pos^'ibly the kind of n''p;af.iv*» resroncie that Gri4i?^iJ3 had hoped 
to avoid, It r.f’eas also tc be note! th-^t ir. this oase the 



progronvne aid not. succeed in provi.diug aa e/iolnnat i.on of ^vhat 
15 unique** In other wordr., this fj.ndin'; has possioie implica-^ 
tions both for produ-'Mon and for toacr.ir.gx for example, it 
would be valuable to know whether some kind of fuller e.xplana- 
tion might tiave helped to roantorpcr the nrgaiive reactions 
that were elicited* The ambiguities inherent, in the children’ e 
reaponsea could also c basis for encouraging tnem to 

• " — nr-- -n - — — ^ 

Ureala Sharma, fiaipp&l aod tllo FaaaXy , Collars. London, ‘'97''* 
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quection th^ir own hiititn nnd :uoto,ro uiid to pur therr into 
re"spccti v^* - o.g. thexr use cf finR^ra to tjsir I'iur ar.cl 
cr.ips. Suer, a thought TUght b.? rcle^'nnt tc noten for 
tea.'.hprs aDout pcsslblo Lines o£ cl;iSvro<m foiJew-up. The 

t 

pirpoi.ntj.ne; of the response tendency involved, howev'er, 

y* 

provider? perhaps one of t.'-ic- rloarest a.edi rations of the kind 
of practical irsignt r.rijt research cr.n offer to educational 
broadcasters* 

5) The differences between schools in poct-vievang 
react ions hav*» already been mentioned at many point** above. 

They emerged yet agai.n on items probing expectations of racial 
lonforraity. Although among pupils wno net few uivnlgrant peers 
at school, t.hc programme fosterea a greater tolerance of 
cultural dlvernit-Y, among those who. wore seeing Pakistanis in 
school every day, there was a cendency to fira racial differences 
of customs and habits Iocs acceptable after ttiewmg the pro- 
gramme than before. Or. many of the items ir. the questionnaire 
the pupils from the high-donsity scncol had gravitated - soraetimec- 
massively - towards a 'don't know* response. 

Given the initially favourable and accepting attitudes 
expressed in this school, the firiding is a striking and per- 
plexing one. It would appear that for those pupils the prograciT.- 
had developed an awareness of differences, and perhaps a 
self-consciousness about tnem, which had not entered into 
their previous thinking to the same extent. This does not mean 
that children in such situations will necessarily adopt more 
negative attitudes afterwards. But it does suggest that they may 
be disturbed in their reactions following the programme and Dor>* 

ic: 



incluned to question v/h?.t the/ hr.d •x.X'n'i'.O'.xr i'f for grarl.c;/. 

In such ciroums Lancer- th*-: clrrrrtor: ;3 iikoly to t'n 

faced witn a complex ret of reaolrcns. v.'li mar,.? drTar.dc 

c) hie or her slulL, srjnr-.it 4 vity cn-'l p.;ic.r p.ver'.r-..-d:;iaa, if 
creat-ivft use is to be madO’ of their, ^ In fact the. c..?.junt 01 
ch.a.nge and variat-iofi evido.ni lu ilic rC'nr,c-nsor from pupiJr i.n 
all four schocis in.d.i:?,to 5 ihut the p'- 0 ( 7 -.V'.-n;--i; is ll.roiy to 
arouse con f jict.i/ig feelings and cpuil in i\ej one cxesr 0'i 
thia subjectr There is e .ery indication that v-j are deaiix.^ 
hero with an area of human :revpc/e.^-;-: invc-j.-ving f ..•.nd£\mental 
value sj’stems* where the child's c'.esi;;a L-j ecu form to the 
customs of his own culture n;.r/ rornlr in a ratu.-c.'. resistance 
to ideas that threaten bis sons- of secu'.-ity and ' hs]ou.Ti- -r- , 

In the end the greatest benefit fi'cm :i stu.'y of this kind may 
lie in the ability of a producer cr Ffucccior. Ofilcar to use 
its findings to help tsooners to ho beicvir lnio;v.eJ about ar.J 
prepared for their diffibi'/.t ta.skr 



EVALUATING THE APPROACH 



CONCLUSIONS: 



T;i£ FE-iiSIBILITY AND aXILlLlf OF THE APPROACH 

The priirary am of tr.e project was to pilot on approach 
to the evaluation of schoolo' broadcast outputs At firet ic 
was hoped that some standardised forms of questaoalog, wnick 
the companies could adroxru.ster to samples of their target 
audiences for schools' progranmes, might bo devised and recomm- 
ended. It roust be clear to any reader of the foregoing account 
of the invc.stiga’‘ioas mat were cor.darted in however, 

how inappropriate such an approach would have been. It is 
liiconceivaole that any single set of procedures could have 
succeeded in acswe^'ing The diverse yet searching questions 
about children’s responses t.o their programmes that concerned 
fne makers of Patterns of Expression , Meeting Our Needs and 
Our Neighbours 1 respectively. The year’s experience has con- 
clusively shown that a serious and responsible evaluation of 
schools' broadcasting necessitates the harnessing of producer- 
oriented questions, a detailed analysis of programmi? content, 

tf 

and teenniquas of 'invest d.gat.ior which nave been "tailored 
sp-cif ically to such questions and content. It is also evident 
than only a trained research worker can choose and adapt the 
latter for application to whatever enquiry' is envisaged. It 
seems tc follow, therefore, that, in order to incorporate a 
systematic research contribution into the schools' broadcasting 
structure of Independent Televisicin, consideration should be 
given to the appointment of a full-time Research Fellow who 
wo'uld be responsible for a) undertaking collaborative invest!- 
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gationc wich the lorapa^uen and b) relating the findijags of 
6un'n studies to a growing body of knov/lodge rioout th? pro- 
cesses of child learning h'a,''ough teievisionn^ Froc. this 
point of view it oncouragjrg that the lessons of the 
past year's work would tend to support such .. step on the 
grounds botf of its feasibility and of irs utility. 

Feasibility 

Practical co'risidera t ions 

The attempt to develop a collaDorative ; esearoher- 
broadcaster relationship proved entirely successful and w;io 
one of the most encouraging feat'urcs of the year’s v/orh. 

There wore no persistent tensions or lUDbridgesbie differences 
of perspective, and it >^ra^s invariably possible to reach agree- 
ment, upon the pairticular features of scP.ooIs’ programming that 
merited investigation. Tha spirit of opon-nindad enquiry 
which prevailed when the studies v.-oro designed also helped to 
ensure that their findings could bo freely discussed without 
a seriss that the interests of anyone roncerned v.'cre being 
threatened. There does not eeem to bo cuiy intrinsic reason, 
then, why sucn a joint ’unaertaking of research activity could 
not be put ' ■'■more pennarient footing and prosper accordingly. 
It IS nevertheless clear that euch forms of ccliabcration depend 
on the development over a period of titna of a personal relation- 
ship of confidence between the researcher and broadcasting staff 
and on the initivation of a mutual interest in and respect for 



* ' I • 

The author has outlined the detaiis or such a proposal ir. a 
letter to the ■Education Officer of tUe ITA, dared May 28, 197'!. 



If 
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oL' \ vo loiw 

Tli.',’ carry jnr> of I'osr.irch on tfo ncn.l.o o •’ I';* a^yc 

Litndi(\s doGcribod ciid nov. rcca to iinnor'o an uridn.o n 

the available tii.io and cner^^.Lo::; of the caanany y)Ci\ .ain.ol 
concox:}o:\* Perlia/a ::or:)C; qurJ.if o:; thxG }'0.i?iL ..‘.a;.;].d 
be i:uiue \:lth rcopoctic') t:io nf:r ii oi:yhbo aaj atudy v;acn.: ;:lic 
peculiarly delieaie natui‘0 oj' the top:ic under ±nvrr-[/\ \l-> or 
proGcnhcd oon^e d J.f ficultlea fo.i‘ the Gram ija. Educati.c i 
when she Gour”ht local authority -vrjv'i school o,pj.)z-'oval ±cr under*' 
taking the rcGcra-'cIi. The adrlitional ofrort i^oquired ;.h. .aae}) 
caoos is probably proportional to the G(nmitiyi ty ar.d eon- 
plexity of the probD.em bein^^, tacklcdo 

It XG also true that cun Education 'Officer * s inxtinl 
Gxporienco of conductin.r^ a rcs^r.u'ch investip'ation wJth yrona;:: 
of children can give rise to 3tra.jn3, especially v/hefi :t is 
important to ensure that _yifloo_l‘c.po oquijvr.cnt is functioning 
efficiently as well as to maintain the rigorous procedures 
involved in running a proper experi-uent. The possibiJity of 
technica], hitches alwayvS renders research of this kind soirio- 
v/hat hazardous* In thcvse cirduristanccs the support ‘(arid some- 
tines the presence) of the researcher can help to case the 
v/ay until such aifficulties appear less formidable v/lth 
familiarity* 



A more \/lde-rangin'g discussion of the problems tiict r.?a 
attend' joint research- production ventures, and of the pre- 
condj.tions of their success, may be found in James Dr 
Halloran and ihichacl Gurevitch, Br o a c? c a s t or/ he s o err. h er 
C o-c r( ;retiori hass Co:ncuaicatiC!: r.eso'trch ; Gen tr : : for 
liass Gr :. iu]iica ticn kecenroh , Vnivero.' i.y of Loi cojItz* , 



Leicester 



h>‘71c 
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As tho above suggests, the succeesful Impleraec-tatioii o-T 
a piece of research depends not only on niuruai respect but 
als2 or. a sefusible sharing of effort bei.wjer, the researcher 
anu comparry mercber. with each person oe .ng ^o.ea.i about his 
own precise roi.a In the overall opera t ion » Th- importance 
of achieving .suer, a 'division of labour .'lems IroT, the fact 
that wnen the b>irden of wo-^^k is appropriately distributed, 
the demands on any single person wiU oe Kept wa'-hui 
reasonable limits,, a.id any interference w;,Th his other 
prof?ssicr.al obligntlors will be ;;Qr.f ir.ei to a minimain. 

The amc-arit of research act ivity to be undertaken in a 
giver, yiar is clearly a ssatter for inaivid'iai coTipany judge- 
neot, Th* scope of the past year’s work probaoly provides 
an approximate giilds to the extent to which any single company 
would normally' wish to commit itself tc research in a 12 --nonth 
period. 



Two ctner considerations, howe'^er, are relevant to the 
scale of a ro.Tipany’s liivoJveracnt in r'^search. One conceriuj 
the need to select woi'thvmile "topics for investigation, which 
have 601 evident practical relevance to the prod;;.':' t ion of 
schools* programmes. The fulfilment of this condition may 
greatly influence what a company ie prepared and able to 
achieve in a short period of time and whether it all seemfi 
worth the effort. For this reason alone it. is essential to 
avoid any semblaace of a routine approacn. 



A further coriBideratioa concerca the potential value for 
a company of being in a position to pursue a particular line 
of research and to follow up leade*and queries emanating from 




continuous and long-term basis* 

■ ‘”i 
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L‘;v: ;i;^ Oi:r l‘o\: ■:r^ :;Uuly .1^ :•» /.-i-j-'-le \.r:< <AA ; . . - 

p.ay ^ Oi.Totirr.or.i poro r.orc I'-ij'Ortant oucvtionn il.-.’*: :i r. l.i. i Li 



rer>olvcc:* Tho ] c';3nj.bi.l:U y of cci:]i:-u:,'.en beinfj irj •• pn.: :i t.ic.’. 
to t'i.clclc proMc;;ns in a rr.nnor c::ab3.08 tncci to buiJd 

}:rO;'^ro:-:oivoly "md to accnrivJ.ate fi?idvp'-:n ho.s d:i':Li’ici - 

t:p;:orj, ::nd it interoi:>tin,^ to note in this conr.^cuion ti: -t 
Yorksliire Television is co-operatin(^‘ I'liis year in a .r*.— rnn 
of the Mooting Our Ne eds orrorimont. *3v,ch cumulative v/o.r!:, 
hov/cver, demands a continuinc association wit}i an involves 
researcher, and this is a further reason for reco::v.-jr:dir.^<^ 
the appointment of a Rosearcii Fellov/ who would be avaj.lab.1o 
for such activity on a more pormanort basis# 



Financial consi^'^crat.i.ons 



The overall costs of mounting the three studies v/hich 
have been outlined were not high* Most of v/hat was spent 
v/as provided by the Independent Television Authority, which 
paid the salaries of a Research Follov/ and a part-tii^ie Clerk 
and met the Fellow's incidental expenses (mainly foi' travel 
and data-processing) up to a limit of about £150* Other 
expenditures involved in :die actual conduct of the expcri'oor.oo 
(o*g# preparation of research materials, busing children, etc. 
were borne by t!ie individual companies. Although such costs 
were variable, they v/ere in each case readily met out of 
existing departmental budgets from the resources available to 
the particular programme series being examined, b'hether sue:: 
an a'orangement would be satisfactory on a continuing basis is 
a mutter Ifoj:* furc'.ier consld Div.Lion by t::c coo.p'.nio . . ' . /. ■ 

boon establislied, however, is t'ne fact that studies of this hi: 



can be ur.dert.aker. a’, relatively expense w;thcut. 

prejudice to the quality of the research inrcr-fd* 

One factor that held costa dowri was the project's 
reliance- on experimental research designs, which (in 
contrast to Eurt^ey fieldwork) need not employ interviewers 
and can mar.e do with a reliti?ely small tuunber of res- 
pondente* Another important factor in limiting expenditure 
was tne placing of final responsibility for the investiga- 
tions in a ’iniTersity research centre. This er.abled 
computer facilities to be used at low cost and data 
proces£ir;g to be undertaxen by graduate studencs at moderate 
rates. 



It can be firmly concluded, therefore, that if there is 
agreement to the priccipl-s of appointing a full-tame Fellow 
to undertake such research in the future, then small-scale 
but iiluiainatirig studies can be mounted and run at a level 
of expenditure that is unlikely to prove prohibitive to the 
ITA or tne Independent companies. 

Dtility 

In Chapters 3 and 4 of thijs report some advantages of 
the kind of approach to prograauae evaluation which was 
followed in the past year were outlined. The three pilot 
studies provide '^vedence to illustrate and support those 
assertions. Some of the main features of the approach, which 
indicates its potential usefulness for schools' broadcasters, 
can now be reiterated in the light of the findings from these 



studies 






X'lll Jl:* lO :zt'^uiic\ b iv : b::o:. )'ot.:; 

/•!]. three ;.i'id:.0G sot out to t:j.c!:l':’ co;pe quo;J.io,u; rvii 
were of specific ;Lru-(?rest to Lhe makers of cchools' ]. re mcr 
in the varionc rr^mpanics. At the same time that thor.o 
queotJ.oiiG v/erc d ;aat v;ith, hov/over. t)ic findings al.:.o helped 
to shed light on noip.e bro-idor iesuos concerning tlu; rc'sec!.:’>e;i 
of c}iildron to e'.iuc'itlonal materials on Lo’l.evision » 

For example, in the case of Onr h' o i rh t ou.ra f r cv^- i a i : i : ^ t ?..n 
the investigation sov.f/nt spr-. c if icall;v Lo establisn hov; f;ir tro 
producer’s ai;n of promoting greater racial i.inderstand' ng was 
likely to be fulfilled. Many of the findings certainly r-rovio-, 
a form of feedbaclc about children* s reac tions, which could be 
especial.ly informative for toacliers using the series; for tax- 
producers, the resuHts also pin-pointed those aspects of the: 
programmie that could bo having an unintended effeett At the 
same tir^:e there wore wider implications in the finding of a 
marked varj.ability of response among children from different 
types of school background, and the outcome of the study may 
also have provided a stimulus to think further about the 
general advisability of producing special:'. sed prcgr''a::.:s for 
children- in the race relations field* 

Similarly, the P atterns of E:cpression study not on.ly 
indicated those parts of the programme under investig. aion 
which the children comprehended most readily, but it also 
spotlighted bhe more general processes involved in t:ie inter- 
action botv/C’cn the way in v/hich a brer least or orp;ani.*cs 
ideas in a precenlation and the chiidi-erPs ov,ci es tasiiwiiea 
of thinlving about the s'xno concepts* 
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Since the i"c-3ultfi of tn.c fiirce studiet; rjrovided a i.uJ [.o 

/• 

detailed character-.! of childrcrf a roanon^co to cl:o 

pro-^rejuiTics under inveotipatior ^ they v/ore i;huc t’O tont'in .li v 
capable of guidinp ^‘udper:. rts about tneir u.se in t}*.o cl.?.:-, ;roo:. 
^nd decicionr about fut\ire productionc. For exeraple, toe 
findings of the Our ileiahbor t.rG ijhndy could help teachora to 
p].an follow-up discussiono by Gcnaitioinp thorn to the Ih-oaeo 
of iT:ind which they mi.pht encounter in cl.asGcs ai'Ler erposvr o 
to such a propraninie. The results ar<i also bcinp consulted at 
present by the producers of the series, who arc currently 
Gn.y;nced in revising Our Iloighbou rr fr o!:i Paki.stan ^ 



er|c 



The Patterns of Fn^uoa s ion study provided a olou.c i -whir * 
cf the extent to which ciiildreu tended to give an order vo v.he 

r 

progra:nr;io natorials cenforning to that of its producer ard }.ev; 
far thc-lr prior ways of categorising things led tho'i: to ro- 
sl:ructi.*.rc the r'atcriols according tc their ov/n predis3:ositia?’Or 
.The Education Officer responsible for the series h-as cO;::.':er.tcd 
t'n.'it the responses i-cvealed by tne study W'ill be of :natc.'rial 
esc j .’::wice ,j f’’ T'.e ,'orcncral‘ior. of f;:ture notes for to.. 
about follov:-up active L'ies as wol]. as in the plainnln:; of sub- 
s ecu e n t o d u c t i o n s r 
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The flndingR of ^he Meeting Our Weeds jitad/ were more 
equxn.cal, requi/i.rg further researon to clarify th^ir 
Implications. They dia, hcwerer, enable the uraducer of 
the series to diagnose, what sequences the children found 
most interesting nn the presentation, and they demonstrated 
the aiulify of chiidrer- to grasp the essential information 
ixi a prcgraaiine when fol lowing a style of oo.Turentary that 
made few roncessions to its child audience. Deoate about 
the advisability of this approacn to scripting for schools 
had initially stirauiated the setting-up of this study, and 

the outcome, although tentati«.'e, tends in some measure to 

/ 

provide support for the producer's original judgement. 

The finAlnge of the prograjme studies have been consistently 
revealing aoout tlie nature of children's responses 

Ir was said in Section ' of this report tioat to evaluate 
a programme was to determine its value for the ’riewing 
children themselves. Although many quest ioip necessarily 
remain unanswered, each of the pilot studies has reveaded 
important infonration. (unLiicely to have been acqulrea by amy 
other method) about the responses of children to the various 
presentations. They Iiave indicated, for example, how children 
may react differently to different parts of a programme - as 
in tbeir diverse judgaments about the cleanliness and eating 
habits of Pakistanis after seeing the Our Neighbours programme, 
and in the contrast between t,heir inability to link hippies 
with penguins, as instances of conformity, in comparison with 
their capacity to see judges and 'x- ' t i::; as examples of 
authority after vievrlng the Patterns, of Ibrpreasio c pd'ograasme. 



They aJLeo indicated haw reepcrsea may differ according 

tc the type of school using a broadcast or the type of class- 
room environment in which it is received. These outcomes 
forrefullv underline thu need to take account of the child's 
own role in the educational process. They must also provide 
Signal leant, insights for producers as well as opporrunitlea 
for them to see ix a fresh light the characteristics of their 
per.eoriai styles of production and to test their beiirfs about 
what are the &ey variables in senoolo' television prograanalng. 

Of course the ultunate judgement about the vaiie of this 
kind of reaearoh must turn on the reactions of schcois’ 
broadcasters themselves, the individua.! producing companies 
and the Independent Television Authority* It would be unfort- 
unate if tills enquiry were taJeea as in any sense definitive. 

It ha.3 been of its nature exploratory and will lead, it is 
hoped, to further mors long-term exploration* 

Nevertheless, beyond the specific contributions of 
individual resecirch findings, a promise of wider benefit 
does sbem to inhere in the overall approach that has been 
developed* Fruitful researcher-producer contacts have been 
established* viable methods of co-operation have been evolved 
and tried out; and insti*uments and methodologies of investi- 
gation have been devised that could eventually form part of 
an expemdlng batteary of evaluative research techniques* More- 
over, should the Independent Television system adopt the peust 
year's enterprise as something of a model for future work in 
this field, it coiold expect gradually to reap the rewards of 
a condition of increasing returns. Mutual understanding of 
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the characteristic problems and rolee suspociated with pro- 
duction and research would grow; methods of evaluation 
would hacome more sophisticated and ffiore capable of providing 
answers to the questions that schools' broadcasters pose about 
their audiences? and the gradual cumulation of findings 
should lead towau'ds a formulation of some generalisations 
about the effectiveness of particular production techniques, 
the responses to educational television of different types of 
pupils, and the interaction between tneir prior outlook and the 
coipnunications experience. It is hoped that further considera- 
tion will now be given to the steps that might be taken to make 
such further advainces possible. 
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NOTE 



!IhlB xeport haa %een produced at the oonolualon of the 
author's tenure of an ITA School teacher Fellovahlp. 

It should be understood that as it is the unanended 
product of the author'a period of atudly the Authority is not 
in a position to vouch for its faotua]. accuracy^ nor does 
any report produced under this aohese necessarily reflect 
tha opiniona either of the Authority or of the ooDqpsnies to 
ehich it refers. 
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